00000100:00100000:2.0F:1787604146.414508:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604146.414640:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0F:1787604146.414741:0:17710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299726592 00000100:00100000:0.0:1787604146.414757:0:17710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299726592 00000100:00100000:0.0:1787604146.414818:0:17710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 28 00000100:00100000:0.0:1787604146.414828:0:17710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+6:2390:x1874438299726592:12345-192.168.203.16@tcp:16:kworker.0 00000100:00100000:0.0:1787604146.414949:0:17710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+6:2390:x1874438299726592:12345-192.168.203.16@tcp:16:kworker.0 Request processed in 122us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604146.414957:0:17710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 28 00000100:00100000:1.0F:1787604146.416673:0:17714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299726464 00000100:00100000:1.0:1787604146.416705:0:17714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299726464 00002000:00100000:1.0:1787604146.416747:0:17714:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffffa09f89352680 x1874438299726464/t0(0) o4->36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6@192.168.203.16@tcp:472/0 lens 504/0 e 0 to 0 dl 1787604157 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1787604146.416757:0:17714:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa09f89352680 with x1874438299726464 ext(0->8) 00002000:00010000:1.0:1787604146.416762:0:17714:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa09f89352680 00000100:00100000:1.0:1787604146.416843:0:17714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:1.0:1787604146.416852:0:17714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+6:2390:x1874438299726464:12345-192.168.203.16@tcp:4:bash.0 00000100:00100000:1.0:1787604146.418596:0:17714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+8:2390:x1874438299726464:12345-192.168.203.16@tcp:4:bash.0 Request processed in 1736us (4087us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787604146.418609:0:17714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 0 00002000:00100000:1.0:1787604146.418621:0:17714:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffffa09f89352680 x1874438299726464/t8589934599(0) o4->36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6@192.168.203.16@tcp:472/0 lens 504/448 e 0 to 0 dl 1787604157 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1787604146.418631:0:17714:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa09f89352680 with x1874438299726464 ext(0->8) 00002000:00010000:1.0:1787604146.418637:0:17714:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa09f89352680 00010000:00010000:1.0:1787604147.015885:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604147.190903:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787604147.190927:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316577792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787604147.191000:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604147.191082:0:17712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316577792 00000100:00100000:0.0:1787604147.191090:0:17712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316577792 00000100:00100000:0.0:1787604147.191153:0:17712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787604147.191163:0:17712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316577792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787604147.191195:0:17712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787604147.191241:0:17712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316577792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604147.191248:0:17712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787604147.191292:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316577792:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787604147.191339:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1787604147.766753:0:6460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934633 is committed 00000001:00080000:2.0:1787604147.766773:0:6460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934634 is committed 00000020:00080000:2.0:1787604147.766794:0:6460:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0a085463540 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:2.0:1787604147.766799:0:6460:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0a08346be00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0a085463600 00000020:00080000:2.0:1787604147.766802:0:6460:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0a08346b100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa09f8127d000 00000020:00080000:2.0:1787604147.766829:0:16436:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00000020:00080000:2.0:1787604147.767027:0:16436:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1787604147.772959:0:3437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc44e400/0x6c241a9cc41dd136 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18010 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604147.772977:0:3437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc44e400/0x6c241a9cc41dd136 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18010 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604147.772986:0:3437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc44e400/0x6c241a9cc41dd136 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18010 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604147.772992:0:3437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc44e400 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1787604147.772997:0:3437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc44e400/0x6c241a9cc41dd136 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18010 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604147.773034:0:3437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc44e400/0x6c241a9cc41dd136 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18010 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604147.773053:0:3437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0a0b3829800) 00010000:00010000:1.0:1787604147.773056:0:3437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787604147.773061:0:3437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc44e400/0x6c241a9cc41dd136 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18010 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604147.773068:0:3437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc44e400/0x6c241a9cc41dd136 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18010 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0F:1787604148.023882:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604148.213906:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787604148.213934:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3453:1874438316577920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787604148.214024:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604148.219941:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316577920 00000100:00100000:3.0:1787604148.219962:0:17037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316577920 00000100:00100000:3.0:1787604148.220039:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787604148.220052:0:17037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1874438316577920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787604148.220112:0:17037:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787604148.220588:0:17037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1874438316577920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 536us (6561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604148.220598:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787604148.220654:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3453:1874438316577920:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787604148.220743:0:3452:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787604148.220756:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcb49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316578048:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787604148.220811:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604148.220900:0:16400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316578048 00000100:00100000:3.0:1787604148.220906:0:16400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316578048 00000100:00100000:3.0:1787604148.220952:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787604148.220959:0:16400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3452:x1874438316578048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787604148.220992:0:16400:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787604148.221041:0:16400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3452:x1874438316578048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604148.221049:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787604148.221083:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcb49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316578048:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787604149.047222:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604149.113997:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604149.118242:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299726720 00000100:00100000:0.0:1787604149.118267:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299726720 00000100:00100000:0.0:1787604149.118363:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 72 00000100:00100000:0.0:1787604149.118390:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+11:15689:x1874438299726720:12345-192.168.203.16@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787604149.118543:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+11:15689:x1874438299726720:12345-192.168.203.16@tcp:60:lhsmtool_posix.0 Request processed in 157us (4559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604149.118561:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 72 00000100:00080000:0.0:1787604149.118593:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787604149.126038:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604149.128724:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299726848 00000100:00100000:3.0:1787604149.128745:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299726848 00000100:00100000:3.0:1787604149.128842:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 73 00000100:00100000:3.0:1787604149.128859:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+5:15689:x1874438299726848:12345-192.168.203.16@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787604149.128999:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+5:15689:x1874438299726848:12345-192.168.203.16@tcp:60:lhsmtool_posix.0 Request processed in 146us (2975us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604149.129008:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 73 00000100:00080000:3.0:1787604149.129037:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787604149.135548:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604149.136291:0:16399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299727104 00000100:00100000:1.0:1787604149.136306:0:16399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299727104 00000100:00100000:1.0:1787604149.136388:0:16399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 16 00000100:00100000:1.0:1787604149.136402:0:16399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c1799850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+11:15689:x1874438299727104:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787604149.137003:0:16399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c1799850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+12:15689:x1874438299727104:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 Request processed in 601us (1465us total) trans 8589934635 rc 0/0 00000100:00100000:1.0:1787604149.137013:0:16399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 16 00000100:00100000:2.0:1787604149.239526:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcb4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316578176:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787604149.239627:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604149.240438:0:17712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316578176 00000100:00100000:3.0:1787604149.240451:0:17712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316578176 00000100:00100000:3.0:1787604149.240594:0:17712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787604149.240607:0:17712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316578176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787604149.240656:0:17712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787604149.240752:0:17712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316578176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 146us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604149.240759:0:17712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787604149.241441:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcb4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316578176:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787604149.241730:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787604149.327870:0:9030:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00010000:00010000:1.0:1787604150.070155:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604150.262322:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787604150.262352:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcb4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3450:1874438316578304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787604150.262456:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604150.262540:0:17712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316578304 00000100:00100000:3.0:1787604150.262550:0:17712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316578304 00000100:00100000:3.0:1787604150.262614:0:17712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787604150.262626:0:17712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1874438316578304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787604150.262655:0:17712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1787604150.262931:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3452:1874438316578432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787604150.264186:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787604150.265180:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787604150.265257:0:17713:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1787604150.265271:0:17713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1787604150.265574:0:17713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316578432 00000100:00100000:2.0:1787604150.265585:0:17713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316578432 00000100:00080000:2.0:1787604150.265656:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787604150.267222:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3453:1874438316578560:0@lo:400:kworker.0 00000100:00100000:1.0:1787604150.267319:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604150.267443:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3450:1874438316578688:0@lo:400:kworker.0 00000100:00100000:1.0:1787604150.267478:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604150.267524:0:16389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316578560 00000100:00100000:1.0:1787604150.267531:0:16389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316578560 00000100:00100000:1.0:1787604150.267577:0:16389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787604150.267605:0:16389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c177b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449a3e36-c3ea-43c4-8436-5c48a977c3d4+24:3453:x1874438316578560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604150.267854:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3451:1874438316578816:0@lo:400:kworker.0 00000100:00100000:0.0:1787604150.267891:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604150.267933:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3451:1874438316579328:0@lo:400:kworker.0 00000100:00100000:0.0:1787604150.268026:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604150.268048:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3451:1874438316579840:0@lo:400:kworker.0 00000100:00100000:0.0:1787604150.268072:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604150.268093:0:3451:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787604150.268099:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316579200:0@lo:400:kworker.0 00000100:00100000:0.0:1787604150.268140:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604150.268161:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3451:1874438316579712:0@lo:400:kworker.0 00000100:00100000:0.0:1787604150.268182:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604150.268212:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316578816 00000100:00100000:0.0:1787604150.268217:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316578816 00000100:00100000:0.0:1787604150.268243:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316579328 00000100:00100000:0.0:1787604150.268246:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316579328 00000100:00100000:0.0:1787604150.268257:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316579840 00000100:00100000:0.0:1787604150.268260:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316579840 00000100:00100000:0.0:1787604150.268284:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316579712 00000100:00100000:0.0:1787604150.268287:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316579712 00000100:00100000:0.0:1787604150.268302:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787604150.268309:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090b78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3451:x1874438316578816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604150.268377:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090b78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3451:x1874438316578816:12345-0@lo:400:kworker.0 Request processed in 68us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604150.268387:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787604150.268406:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787604150.268412:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3451:x1874438316579328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604150.268441:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3451:x1874438316579328:12345-0@lo:400:kworker.0 Request processed in 29us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604150.268447:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787604150.268458:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787604150.268464:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3451:x1874438316579840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604150.268491:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3451:x1874438316579840:12345-0@lo:400:kworker.0 Request processed in 28us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604150.268497:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787604150.268508:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787604150.268516:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3451:x1874438316579712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604150.268541:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3451:x1874438316579712:12345-0@lo:400:kworker.0 Request processed in 27us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604150.268546:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787604150.268572:0:18305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316579200 00000100:00100000:0.0:1787604150.268576:0:18305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316579200 00000100:00100000:0.0:1787604150.268604:0:18305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787604150.268611:0:18305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316579200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604150.268640:0:18305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316579200:12345-0@lo:400:kworker.0 Request processed in 30us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604150.268645:0:18305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787604150.268879:0:16389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c177b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449a3e36-c3ea-43c4-8436-5c48a977c3d4+24:3453:x1874438316578560:12345-0@lo:400:kworker.0 Request processed in 1275us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604150.268889:0:16389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787604150.268942:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7b3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316579072:0@lo:400:kworker.0 00000100:00100000:1.0:1787604150.269469:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604150.269483:0:19470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787604150.269497:0:19470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7b3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3452:x1874438316578432:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787604150.269505:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3453:1874438316579584:0@lo:400:kworker.0 00000100:00100000:1.0:1787604150.269539:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604150.269575:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3453:1874438316578560:0@lo:400:kworker.0 00000100:00100000:1.0:1787604150.269597:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787604150.269603:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316578944:0@lo:400:kworker.0 00000100:00100000:1.0:1787604150.269629:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604150.269649:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3453:1874438316579456:0@lo:400:kworker.0 00000100:00100000:1.0:1787604150.270562:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604150.270628:0:16401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316578688 00000100:00100000:1.0:1787604150.270635:0:16401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316578688 00000100:00100000:0.0:1787604150.270760:0:18305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316579072 00000100:00100000:0.0:1787604150.270765:0:18305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316579072 00000100:00100000:0.0:1787604150.270811:0:18305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787604150.270820:0:18305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316579072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604150.270891:0:18305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316579072:12345-0@lo:400:kworker.0 Request processed in 72us (1424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604150.270899:0:18305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787604150.270924:0:16397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316579584 00000100:00100000:1.0:1787604150.271799:0:16401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316578944 00000100:00100000:1.0:1787604150.271808:0:16401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316578944 00000100:00100000:1.0:1787604150.271836:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787604150.271845:0:16401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3450:x1874438316578688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604150.271919:0:16401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3450:x1874438316578688:12345-0@lo:400:kworker.0 Request processed in 75us (4439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604150.271926:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787604150.271953:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787604150.272049:0:16397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316579584 00000100:00100000:0.0:1787604150.272085:0:16397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316579456 00000100:00100000:0.0:1787604150.272088:0:16397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316579456 00000100:00100000:0.0:1787604150.272105:0:16397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787604150.272112:0:16397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3453:x1874438316579584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604150.272150:0:16397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3453:x1874438316579584:12345-0@lo:400:kworker.0 Request processed in 39us (2611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604150.272156:0:16397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787604150.272233:0:17712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1874438316578304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9607us (9775us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604150.272244:0:17712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787604150.272331:0:16401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316578944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604150.272399:0:16401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316578944:12345-0@lo:400:kworker.0 Request processed in 72us (2768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604150.272418:0:16397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787604150.272429:0:16397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3453:x1874438316579456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604150.272463:0:16397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3453:x1874438316579456:12345-0@lo:400:kworker.0 Request processed in 36us (1907us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604150.272469:0:16397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1787604150.272489:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787604150.272496:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787604150.272498:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787604150.272542:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316579200:0@lo:400:kworker.0 00000100:00100000:0.0:1787604150.272558:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3451:1874438316579712:0@lo:400:kworker.0 00000100:00100000:0.0:1787604150.272572:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3451:1874438316578816:0@lo:400:kworker.0 00000100:00100000:0.0:1787604150.272598:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3451:1874438316579328:0@lo:400:kworker.0 00010000:00080000:0.0:1787604150.272616:0:3451:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0a0b7b38700 x1874438316579840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604150.272628:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3451:1874438316579840:0@lo:400:kworker.0 00000100:00100000:0.0:1787604150.272832:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316578944:0@lo:400:kworker.0 00000100:00100000:0.0:1787604150.272847:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3453:1874438316579456:0@lo:400:kworker.0 00000100:00100000:0.0:1787604150.272861:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7b3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316579072:0@lo:400:kworker.0 00010000:00080000:0.0:1787604150.272877:0:3453:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0a0b7b39c00 x1874438316579584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604150.272887:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3453:1874438316579584:0@lo:400:kworker.0 00000100:00100000:3.0:1787604150.272904:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3450:1874438316578688:0@lo:400:kworker.0 00000100:00100000:3.0:1787604150.272934:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcb4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3450:1874438316578304:0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787604150.273649:0:19470:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787604150.274176:0:19470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7b3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3452:x1874438316578432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4679us (9992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604150.274402:0:19470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787604150.275800:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787604150.283877:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3452:1874438316578432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787604150.507856:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604150.507949:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604150.508307:0:16397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299727360 00000100:00100000:0.0:1787604150.508321:0:16397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299727360 00000100:00100000:0.0:1787604150.508418:0:16397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 80 00000100:00100000:0.0:1787604150.508432:0:16397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+12:2392:x1874438299727360:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787604150.508621:0:16390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299727232 00000100:00100000:2.0:1787604150.508628:0:16390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299727232 00000100:00100000:2.0:1787604150.508675:0:16390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 172 00000100:00100000:2.0:1787604150.508714:0:16390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c1779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8312a58-502b-4128-8f8b-3a527e86ed10+13:2392:x1874438299727232:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787604150.508725:0:16397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+12:2392:x1874438299727360:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 294us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604150.508736:0:16397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 80 00000100:00100000:2.0:1787604150.508751:0:16390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c1779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8312a58-502b-4128-8f8b-3a527e86ed10+13:2392:x1874438299727232:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 67us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604150.508760:0:16390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 172 00000100:00100000:3.0:1787604150.511555:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604150.511732:0:18010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299727488 00000100:00100000:0.0:1787604150.511745:0:18010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299727488 00000100:00100000:0.0:1787604150.511818:0:18010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 81 00000100:00100000:0.0:1787604150.511830:0:18010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+5:2392:x1874438299727488:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787604150.511929:0:18010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+5:2392:x1874438299727488:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 100us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604150.511958:0:18010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 81 00000100:00100000:3.0:1787604150.520148:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604150.520593:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299727616 00000100:00100000:2.0:1787604150.520608:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299727616 00000100:00080000:0.0:1787604150.521145:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787604150.521287:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 29 00000100:00100000:2.0:1787604150.521302:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+5:2389:x1874438299727616:12345-192.168.203.16@tcp:9:kworker.0 00000020:00000080:2.0:1787604150.521344:0:18751:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dcdfc 00000100:00080000:2.0:1787604150.521374:0:18751:0:(import.c:65:import_set_state_nolock()) ffffa09f88837800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787604150.522192:0:18751:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:3.0:1787604150.522816:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604150.523842:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604150.523973:0:17708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299727744 00000100:00100000:1.0:1787604150.523987:0:17708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299727744 00000100:00080000:0.0:1787604150.524225:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787604150.524292:0:17708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 34 00000100:00100000:1.0:1787604150.524304:0:17708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+6:2393:x1874438299727744:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787604150.525015:0:17708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+6:2393:x1874438299727744:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 706us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604150.525026:0:17708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 34 00000100:00100000:2.0:1787604150.526886:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+2:2389:x1874438299727616:12345-192.168.203.16@tcp:9:kworker.0 Request processed in 5574us (6747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604150.526904:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 29 00000100:00100000:3.0:1787604150.537837:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604150.537888:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604150.537921:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604150.537958:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604150.538006:0:18305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299728128 00000100:00100000:3.0:1787604150.538020:0:18305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299728128 00000100:00100000:1.0:1787604150.538246:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299727872 00000100:00100000:1.0:1787604150.538252:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299727872 00000100:00100000:1.0:1787604150.538302:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299728000 00000100:00100000:1.0:1787604150.538306:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299728000 00000100:00100000:1.0:1787604150.538334:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 82 00000100:00100000:1.0:1787604150.538347:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4505ec14-9a6c-40ba-9bbd-eece9d8c93ba+6:2392:x1874438299727872:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787604150.538472:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4505ec14-9a6c-40ba-9bbd-eece9d8c93ba+6:2392:x1874438299727872:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 127us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604150.538481:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 82 00000100:00100000:1.0:1787604150.538501:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 83 00000100:00100000:1.0:1787604150.538508:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4505ec14-9a6c-40ba-9bbd-eece9d8c93ba+5:2393:x1874438299728000:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787604150.538536:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4505ec14-9a6c-40ba-9bbd-eece9d8c93ba+5:2393:x1874438299728000:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 28us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604150.538542:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 83 00000100:00080000:1.0:1787604150.538723:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787604150.538745:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787604150.538749:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787604150.538834:0:17710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299728256 00000100:00100000:2.0:1787604150.538845:0:17710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299728256 00000100:00100000:2.0:1787604150.538893:0:17710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 30 00000100:00100000:2.0:1787604150.538902:0:17710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4505ec14-9a6c-40ba-9bbd-eece9d8c93ba+5:2389:x1874438299728256:12345-192.168.203.16@tcp:9:kworker.0 00000020:00000080:2.0:1787604150.538925:0:17710:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dce3b 00000100:00080000:2.0:1787604150.538945:0:17710:0:(import.c:65:import_set_state_nolock()) ffffa0a0bceb8800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787604150.538994:0:17710:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1787604150.539350:0:17710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4505ec14-9a6c-40ba-9bbd-eece9d8c93ba+2:2389:x1874438299728256:12345-192.168.203.16@tcp:9:kworker.0 Request processed in 447us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604150.539368:0:17710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 30 00010000:00010000:2.0:1787604150.539424:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604150.539620:0:18305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 31 00000100:00100000:3.0:1787604150.539632:0:18305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4505ec14-9a6c-40ba-9bbd-eece9d8c93ba+5:2389:x1874438299728128:12345-192.168.203.16@tcp:9:kworker.0 00000020:00000080:3.0:1787604150.539656:0:18305:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dce42 00000100:00080000:3.0:1787604150.539663:0:18305:0:(import.c:65:import_set_state_nolock()) ffffa0a0bcb59800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787604150.539720:0:18305:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1787604150.539850:0:18305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4505ec14-9a6c-40ba-9bbd-eece9d8c93ba+2:2389:x1874438299728128:12345-192.168.203.16@tcp:9:kworker.0 Request processed in 221us (1927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604150.539857:0:18305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 31 00000100:00080000:1.0:1787604150.540202:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787604150.540746:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604151.095508:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787604151.320511:0:8099:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6 00000020:00000080:0.0:1787604151.320522:0:8099:0:(genops.c:885:class_export_put()) final put ffffa09f88836800/36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6 00000001:00100000:0.0:1787604151.320557:0:8099:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4505ec14-9a6c-40ba-9bbd-eece9d8c93ba 00000020:00000080:0.0:1787604151.320560:0:8099:0:(genops.c:885:class_export_put()) final put ffffa0a0bcb58000/4505ec14-9a6c-40ba-9bbd-eece9d8c93ba 00000020:00000080:1.0:1787604151.320610:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f88836800/36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6 for lustre-OST0000 00000020:00000080:1.0:1787604151.320800:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0bcb58000/4505ec14-9a6c-40ba-9bbd-eece9d8c93ba for lustre-OST0000 00000020:00000080:1.0:1787604151.320825:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa09f88837800 for lustre-OST0000 00000020:00000080:1.0:1787604151.320831:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0a0bcb59800 for lustre-OST0000 00000040:00080000:3.0:1787604151.864463:0:16431:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787604151.864473:0:16431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787604151.864519:0:16431:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787604151.864526:0:16431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787604152.117894:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604152.314984:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787604152.315014:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c179e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316579968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787604152.315102:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604152.315159:0:17713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316579968 00000100:00100000:0.0:1787604152.315168:0:17713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316579968 00000100:00100000:0.0:1787604152.315235:0:17713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787604152.315247:0:17713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c179e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316579968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787604152.315293:0:17713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787604152.315359:0:17713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c179e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316579968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604152.315367:0:17713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1787604152.315392:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787604152.315429:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c179e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316579968:0@lo:13:osp-pre-0-1.0 00000001:00080000:0.0:1787604152.939806:0:6460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:0.0:1787604152.939826:0:6460:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:3.0:1787604152.939888:0:16436:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:3.0:1787604152.939900:0:16436:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00010000:00010000:3.0:1787604153.143797:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787604153.341447:0:17050:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787604153.341566:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c179e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3453:1874438316580096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787604153.341658:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604153.342222:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316580096 00000100:00100000:3.0:1787604153.342232:0:17037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316580096 00000100:00100000:3.0:1787604153.342288:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787604153.342301:0:17037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c179c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1874438316580096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787604153.342365:0:17037:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787604153.342438:0:17037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c179c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1874438316580096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 139us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604153.342446:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787604153.342580:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcb49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316580224:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787604153.342618:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604153.342656:0:16400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316580224 00000100:00100000:3.0:1787604153.342661:0:16400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316580224 00000100:00100000:3.0:1787604153.342707:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787604153.342715:0:16400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316580224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787604153.342741:0:16400:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787604153.342780:0:16400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316580224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604153.342787:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787604153.342834:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c179e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3453:1874438316580096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787604153.342870:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcb49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316580224:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787604154.167090:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604154.364964:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787604154.364988:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316580352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787604154.365068:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604154.365133:0:19470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316580352 00000100:00100000:2.0:1787604154.365142:0:19470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316580352 00000100:00100000:2.0:1787604154.365197:0:19470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787604154.365206:0:19470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89351f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316580352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787604154.365241:0:19470:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787604154.365284:0:19470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89351f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316580352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604154.365292:0:19470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787604154.365327:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316580352:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787604154.365870:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1787604154.448891:0:9030:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4505ec14-9a6c-40ba-9bbd-eece9d8c93ba 00000020:00000080:3.0:1787604154.448901:0:9030:0:(genops.c:885:class_export_put()) final put ffffa09f88834800/4505ec14-9a6c-40ba-9bbd-eece9d8c93ba 00000020:00000080:2.0:1787604154.448965:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f88834800/4505ec14-9a6c-40ba-9bbd-eece9d8c93ba for lustre-OST0001 00000020:00000080:2.0:1787604154.449019:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0a0bceb8800 for lustre-OST0001 00010000:00010000:2.0:1787604155.190169:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604155.381938:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787604155.381979:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcb49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3453:1874438316580480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787604155.382056:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604155.382120:0:17712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316580480 00000100:00100000:3.0:1787604155.382128:0:17712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316580480 00000100:00100000:3.0:1787604155.382187:0:17712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787604155.382198:0:17712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3453:x1874438316580480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787604155.382237:0:17712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787604155.382290:0:17712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3453:x1874438316580480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604155.382298:0:17712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1787604155.382317:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787604155.382441:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcb49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3453:1874438316580480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787604155.382655:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3453:1874438316580608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787604155.382703:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604155.382737:0:17713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316580608 00000100:00100000:1.0:1787604155.382741:0:17713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316580608 00000100:00100000:1.0:1787604155.382773:0:17713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787604155.382780:0:17713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3453:x1874438316580608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787604155.382793:0:17713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787604155.382827:0:17713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3453:x1874438316580608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604155.382834:0:17713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1787604155.382848:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787604155.382870:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3453:1874438316580608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787604155.387748:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7790700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3452:1874438316580992:0@lo:400:kworker.0 00000100:00100000:1.0:1787604155.387814:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604155.387844:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3452:1874438316581504:0@lo:400:kworker.0 00000100:00100000:1.0:1787604155.387863:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604155.387880:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3452:1874438316582016:0@lo:400:kworker.0 00000100:00100000:1.0:1787604155.387899:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604155.387923:0:3452:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787604155.387941:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316581120:0@lo:400:kworker.0 00000100:00100000:1.0:1787604155.387966:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604155.387984:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3452:1874438316581632:0@lo:400:kworker.0 00000100:00100000:1.0:1787604155.388003:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604155.388033:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316580992 00000100:00100000:1.0:1787604155.388041:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316580992 00000100:00100000:1.0:1787604155.388078:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316581504 00000100:00100000:1.0:1787604155.388081:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316581504 00000100:00100000:1.0:1787604155.388093:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316582016 00000100:00100000:1.0:1787604155.388096:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316582016 00000100:00100000:1.0:1787604155.388117:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316581632 00000100:00100000:1.0:1787604155.388120:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316581632 00000100:00100000:1.0:1787604155.388136:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787604155.388145:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3452:x1874438316580992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604155.388194:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3452:x1874438316580992:12345-0@lo:400:kworker.0 Request processed in 50us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604155.388201:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787604155.388218:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787604155.388223:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7b39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3452:x1874438316581504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604155.388249:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7b39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3452:x1874438316581504:12345-0@lo:400:kworker.0 Request processed in 26us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604155.388255:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787604155.388266:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787604155.388272:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7b39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3452:x1874438316582016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604155.388297:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7b39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3452:x1874438316582016:12345-0@lo:400:kworker.0 Request processed in 26us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604155.388303:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787604155.388338:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787604155.388345:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3452:x1874438316581632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604155.388471:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316580864:0@lo:400:kworker.0 00000100:00100000:0.0:1787604155.388501:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604155.388531:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316581376:0@lo:400:kworker.0 00000100:00100000:0.0:1787604155.388552:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604155.388566:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3451:1874438316581888:0@lo:400:kworker.0 00000100:00100000:0.0:1787604155.388584:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604155.388597:0:3451:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787604155.388602:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3451:1874438316580736:0@lo:400:kworker.0 00000100:00100000:0.0:1787604155.388626:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604155.388647:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7790a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316581248:0@lo:400:kworker.0 00000100:00100000:0.0:1787604155.388667:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604155.388682:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7b3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3451:1874438316581760:0@lo:400:kworker.0 00000100:00100000:0.0:1787604155.388721:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604155.388742:0:16401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316581120 00000100:00100000:0.0:1787604155.388746:0:16401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316581120 00000100:00100000:0.0:1787604155.388770:0:16401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316580864 00000100:00100000:0.0:1787604155.388773:0:16401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316580864 00000100:00100000:0.0:1787604155.388785:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787604155.388792:0:16401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7b38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3452:x1874438316581120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604155.388824:0:16401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7b38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3452:x1874438316581120:12345-0@lo:400:kworker.0 Request processed in 32us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604155.388831:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787604155.388844:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787604155.388849:0:16401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c179d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3451:x1874438316580864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604155.388878:0:16401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c179d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3451:x1874438316580864:12345-0@lo:400:kworker.0 Request processed in 28us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604155.388891:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787604155.388910:0:17711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316581376 00000100:00100000:0.0:1787604155.388913:0:17711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316581376 00000100:00100000:0.0:1787604155.388936:0:17711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316581248 00000100:00100000:0.0:1787604155.388939:0:17711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316581248 00000100:00100000:0.0:1787604155.388958:0:17711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787604155.388964:0:17711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c179d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316581376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604155.388994:0:17711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c179d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316581376:12345-0@lo:400:kworker.0 Request processed in 31us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604155.389000:0:17711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787604155.389010:0:17711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787604155.389017:0:17711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c1731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316581248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604155.389042:0:17711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c1731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316581248:12345-0@lo:400:kworker.0 Request processed in 26us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604155.389047:0:17711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787604155.389083:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7790a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316581248:0@lo:400:kworker.0 00000100:00100000:0.0:1787604155.389092:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316580864:0@lo:400:kworker.0 00000100:00100000:0.0:1787604155.389099:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316581376:0@lo:400:kworker.0 00000100:00100000:1.0:1787604155.390548:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3452:x1874438316581632:12345-0@lo:400:kworker.0 Request processed in 2196us (2537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604155.390560:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787604155.390581:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316581888 00000100:00100000:1.0:1787604155.390586:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316581888 00000100:00100000:1.0:1787604155.390610:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316581760 00000100:00100000:1.0:1787604155.390612:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316581760 00000100:00100000:1.0:1787604155.390624:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787604155.390630:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c179e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3451:x1874438316581888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604155.390667:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c179e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3451:x1874438316581888:12345-0@lo:400:kworker.0 Request processed in 37us (2081us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604155.390673:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787604155.390704:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787604155.390712:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c1731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3451:x1874438316581760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604155.390739:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c1731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3451:x1874438316581760:12345-0@lo:400:kworker.0 Request processed in 28us (2018us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604155.390744:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787604155.390782:0:16389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316580736 00000100:00100000:1.0:1787604155.390786:0:16389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316580736 00000100:00100000:1.0:1787604155.390809:0:16389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787604155.390815:0:16389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c177b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449a3e36-c3ea-43c4-8436-5c48a977c3d4+24:3451:x1874438316580736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604155.390843:0:16389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c177b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449a3e36-c3ea-43c4-8436-5c48a977c3d4+24:3451:x1874438316580736:12345-0@lo:400:kworker.0 Request processed in 28us (2216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604155.390849:0:16389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:1.0:1787604155.390875:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787604155.390890:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787604155.390892:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787604155.390926:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316581120:0@lo:400:kworker.0 00000100:00100000:1.0:1787604155.390937:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3452:1874438316581632:0@lo:400:kworker.0 00000100:00100000:1.0:1787604155.390947:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7790700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3452:1874438316580992:0@lo:400:kworker.0 00000100:00100000:1.0:1787604155.390957:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3452:1874438316581504:0@lo:400:kworker.0 00010000:00080000:1.0:1787604155.390970:0:3452:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0a0b7b3a680 x1874438316582016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604155.390980:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3452:1874438316582016:0@lo:400:kworker.0 00000100:00100000:2.0:1787604155.392092:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3451:1874438316580736:0@lo:400:kworker.0 00010000:00080000:2.0:1787604155.392110:0:3451:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0a0b7b3b800 x1874438316581760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787604155.392120:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7b3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3451:1874438316581760:0@lo:400:kworker.0 00000100:00100000:2.0:1787604155.392132:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3451:1874438316581888:0@lo:400:kworker.0 00000100:00100000:0.0:1787604155.628395:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604155.628429:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604155.628459:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604155.628483:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604155.628617:0:16388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299728384 00000100:00100000:1.0:1787604155.628626:0:16388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299728384 00000100:00100000:1.0:1787604155.628682:0:16388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 174 00000100:00100000:1.0:1787604155.628711:0:16388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c177bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8312a58-502b-4128-8f8b-3a527e86ed10+13:2392:x1874438299728384:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787604155.628780:0:16388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c177bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8312a58-502b-4128-8f8b-3a527e86ed10+13:2392:x1874438299728384:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 70us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604155.628787:0:16388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 174 00000100:00100000:1.0:1787604155.628902:0:18010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299728640 00000100:00100000:1.0:1787604155.628907:0:18010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299728640 00000100:00100000:1.0:1787604155.628940:0:18010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299728896 00000100:00100000:1.0:1787604155.628943:0:18010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299728896 00000100:00100000:1.0:1787604155.628954:0:18010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299728512 00000100:00100000:1.0:1787604155.628956:0:18010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299728512 00000100:00100000:1.0:1787604155.628968:0:18010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 90 00000100:00100000:1.0:1787604155.628974:0:18010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c1731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+5:2392:x1874438299728640:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787604155.629010:0:18010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c1731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+5:2392:x1874438299728640:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 36us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604155.629025:0:18010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 90 00000100:00100000:1.0:1787604155.629038:0:18010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 91 00000100:00100000:1.0:1787604155.629045:0:18010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c1730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4505ec14-9a6c-40ba-9bbd-eece9d8c93ba+6:2392:x1874438299728896:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787604155.629072:0:18010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c1730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4505ec14-9a6c-40ba-9bbd-eece9d8c93ba+6:2392:x1874438299728896:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 28us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604155.629078:0:18010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 91 00000100:00100000:1.0:1787604155.629089:0:18010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 92 00000100:00100000:1.0:1787604155.629095:0:18010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c1733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+11:2392:x1874438299728512:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787604155.629132:0:18010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c1733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+11:2392:x1874438299728512:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 37us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604155.629152:0:18010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 92 00000100:00080000:1.0:1787604155.629441:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787604155.629446:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787604155.630590:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604155.630633:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604155.630799:0:18305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299728768 00000100:00100000:1.0:1787604155.630806:0:18305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299728768 00000100:00100000:1.0:1787604155.630867:0:18305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 37 00000100:00100000:1.0:1787604155.630876:0:18305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c1731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+6:2392:x1874438299728768:12345-192.168.203.16@tcp:400:kworker.0 00000100:00080000:0.0:1787604155.630995:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787604155.632437:0:18305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c1731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+6:2392:x1874438299728768:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 1553us (1844us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604155.632449:0:18305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 37 00000100:00100000:1.0:1787604155.632490:0:18010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299729024 00000100:00100000:1.0:1787604155.632497:0:18010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299729024 00000100:00100000:1.0:1787604155.632559:0:18010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 93 00000100:00100000:1.0:1787604155.632568:0:18010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c1732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4505ec14-9a6c-40ba-9bbd-eece9d8c93ba+5:2392:x1874438299729024:12345-192.168.203.16@tcp:400:kworker.0 00000100:00080000:2.0:1787604155.632714:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787604155.633006:0:18010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c1732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4505ec14-9a6c-40ba-9bbd-eece9d8c93ba+5:2392:x1874438299729024:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 437us (2371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604155.633013:0:18010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 93 00010000:00010000:2.0:1787604156.214748:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604157.242988:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604157.431166:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c1730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316582144:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787604157.431238:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604157.431346:0:17713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316582144 00000100:00100000:0.0:1787604157.431356:0:17713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316582144 00000100:00100000:0.0:1787604157.431422:0:17713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787604157.431432:0:17713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316582144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787604157.431467:0:17713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787604157.431514:0:17713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316582144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604157.431522:0:17713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787604157.431567:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c1730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316582144:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787604157.431710:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787604158.262106:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604158.455290:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3450:1874438316582272:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787604158.455373:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604158.455615:0:16401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316582272 00000100:00100000:0.0:1787604158.455623:0:16401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316582272 00000100:00100000:0.0:1787604158.455668:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787604158.455678:0:16401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3450:x1874438316582272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787604158.455739:0:16401:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787604158.455787:0:16401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3450:x1874438316582272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604158.455794:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787604158.455879:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3450:1874438316582272:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787604158.455895:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787604158.455901:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c1730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316582400:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787604158.455924:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604158.455983:0:16400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316582400 00000100:00100000:0.0:1787604158.455987:0:16400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316582400 00000100:00100000:0.0:1787604158.456016:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787604158.456023:0:16400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316582400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787604158.456056:0:16400:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787604158.456092:0:16400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316582400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604158.456098:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787604158.456126:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c1730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316582400:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787604159.286113:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604159.478032:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787604159.478053:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcb49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316582528:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787604159.478135:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604159.478205:0:19470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316582528 00000100:00100000:3.0:1787604159.478213:0:19470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316582528 00000100:00100000:3.0:1787604159.478264:0:19470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787604159.478274:0:19470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcd60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316582528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787604159.478317:0:19470:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787604159.478371:0:19470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcd60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316582528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604159.478379:0:19470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787604159.478420:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcb49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316582528:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787604159.478644:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787604160.320359:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604160.502410:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcd62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3453:1874438316582656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787604160.502607:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604160.502734:0:17712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316582656 00000100:00100000:3.0:1787604160.502744:0:17712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316582656 00000100:00100000:3.0:1787604160.502815:0:17712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787604160.502839:0:17712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcd61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3453:x1874438316582656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787604160.502885:0:17712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787604160.502941:0:17712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcd61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3453:x1874438316582656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604160.502948:0:17712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1787604160.502974:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787604160.503599:0:3451:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787604160.503615:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316582784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787604160.503660:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604160.504654:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bc4a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316583296:0@lo:400:kworker.0 00000100:00100000:0.0:1787604160.504728:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604160.504759:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3450:1874438316583808:0@lo:400:kworker.0 00000100:00100000:0.0:1787604160.504786:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604160.504814:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787604160.504820:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcd63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3450:1874438316582912:0@lo:400:kworker.0 00000100:00100000:0.0:1787604160.504851:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604160.504879:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bc85d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316583424:0@lo:400:kworker.0 00000100:00100000:0.0:1787604160.504906:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604160.504923:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3450:1874438316583936:0@lo:400:kworker.0 00000100:00100000:0.0:1787604160.504942:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604160.504972:0:17713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316582784 00000100:00100000:0.0:1787604160.504981:0:17713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316582784 00000100:00100000:0.0:1787604160.505036:0:17713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787604160.505047:0:17713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7b38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3451:x1874438316582784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787604160.505074:0:17713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787604160.505121:0:17713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7b38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3451:x1874438316582784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (1459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604160.505128:0:17713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787604160.505154:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316583296 00000100:00100000:0.0:1787604160.505157:0:17037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316583296 00000100:00100000:0.0:1787604160.505185:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787604160.505192:0:17037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c1730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316583296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604160.505231:0:17037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c1730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316583296:12345-0@lo:400:kworker.0 Request processed in 40us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604160.505257:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787604160.505279:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316583808 00000100:00100000:0.0:1787604160.505283:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316583808 00000100:00100000:0.0:1787604160.505337:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316583936 00000100:00100000:0.0:1787604160.505340:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316583936 00000100:00100000:0.0:1787604160.505374:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787604160.505381:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c1731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3450:x1874438316583808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604160.505414:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c1731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3450:x1874438316583808:12345-0@lo:400:kworker.0 Request processed in 33us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604160.505420:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787604160.505432:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787604160.505437:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c1732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3450:x1874438316583936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604160.505465:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c1732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3450:x1874438316583936:12345-0@lo:400:kworker.0 Request processed in 28us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604160.505471:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787604160.505501:0:16390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316582912 00000100:00100000:0.0:1787604160.505505:0:16390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316582912 00000100:00100000:0.0:1787604160.505530:0:16390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787604160.505537:0:16390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c1778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449a3e36-c3ea-43c4-8436-5c48a977c3d4+24:3450:x1874438316582912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604160.505566:0:16390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c1778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449a3e36-c3ea-43c4-8436-5c48a977c3d4+24:3450:x1874438316582912:12345-0@lo:400:kworker.0 Request processed in 30us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604160.505572:0:16390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787604160.505602:0:17710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316583424 00000100:00100000:0.0:1787604160.505607:0:17710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316583424 00000100:00100000:0.0:1787604160.505636:0:17710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787604160.505642:0:17710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c1730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316583424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604160.505683:0:17710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c1730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316583424:12345-0@lo:400:kworker.0 Request processed in 41us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604160.505713:0:17710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787604160.505759:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcd63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3450:1874438316582912:0@lo:400:kworker.0 00000100:00100000:0.0:1787604160.505774:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bc85d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316583424:0@lo:400:kworker.0 00010000:00080000:0.0:1787604160.505787:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0a0c0c07100 x1874438316583936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604160.505798:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3450:1874438316583936:0@lo:400:kworker.0 00000100:00100000:0.0:1787604160.505808:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bc4a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316583296:0@lo:400:kworker.0 00000100:00100000:0.0:1787604160.505817:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3450:1874438316583808:0@lo:400:kworker.0 00000100:00080000:0.0:1787604160.505860:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787604160.505866:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787604160.505869:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787604160.505871:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787604160.508717:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcb49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3452:1874438316583040:0@lo:400:kworker.0 00000100:00100000:1.0:1787604160.508749:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316582784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787604160.508818:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604160.508860:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316583552:0@lo:400:kworker.0 00000100:00100000:3.0:1787604160.508888:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604160.508912:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3452:1874438316584064:0@lo:400:kworker.0 00000100:00100000:3.0:1787604160.508937:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604160.508961:0:3452:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787604160.508968:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bc4a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3452:1874438316583168:0@lo:400:kworker.0 00000100:00100000:3.0:1787604160.508996:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604160.509013:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3452:1874438316583680:0@lo:400:kworker.0 00000100:00100000:3.0:1787604160.509037:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604160.509052:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3452:1874438316584192:0@lo:400:kworker.0 00000100:00100000:3.0:1787604160.509073:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604160.509118:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcd62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3453:1874438316582656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787604160.509211:0:16401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316583040 00000100:00100000:1.0:1787604160.509220:0:16401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316583040 00000100:00100000:1.0:1787604160.509357:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787604160.510120:0:16401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0c04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3452:x1874438316583040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604160.510226:0:16401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0c04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3452:x1874438316583040:12345-0@lo:400:kworker.0 Request processed in 117us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604160.510501:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316584064 00000100:00100000:0.0:1787604160.510510:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316584064 00000100:00100000:0.0:1787604160.510560:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316583168 00000100:00100000:0.0:1787604160.510563:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316583168 00000100:00100000:0.0:1787604160.510575:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316583680 00000100:00100000:0.0:1787604160.510578:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316583680 00000100:00100000:0.0:1787604160.510589:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316584192 00000100:00100000:0.0:1787604160.510591:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316584192 00000100:00100000:0.0:1787604160.510608:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787604160.510616:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0c07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3452:x1874438316584064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604160.510661:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0c07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3452:x1874438316584064:12345-0@lo:400:kworker.0 Request processed in 46us (1722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604160.510681:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787604160.510717:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787604160.510723:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b6f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3452:x1874438316583168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604160.510755:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787604160.510760:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b6f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3452:x1874438316583168:12345-0@lo:400:kworker.0 Request processed in 35us (1761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604160.510769:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787604160.510786:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787604160.510793:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b6f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3452:x1874438316583680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604160.510816:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bc4a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3452:1874438316583168:0@lo:400:kworker.0 00000100:00100000:0.0:1787604160.510829:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b6f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3452:x1874438316583680:12345-0@lo:400:kworker.0 Request processed in 34us (1788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604160.510837:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787604160.510848:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3452:1874438316583680:0@lo:400:kworker.0 00000100:00100000:0.0:1787604160.510854:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787604160.510863:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b6f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3452:x1874438316584192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604160.510869:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcb49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3452:1874438316583040:0@lo:400:kworker.0 00000100:00100000:1.0:1787604160.510885:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3452:1874438316584064:0@lo:400:kworker.0 00000100:00100000:0.0:1787604160.510904:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b6f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3452:x1874438316584192:12345-0@lo:400:kworker.0 Request processed in 41us (1828us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604160.510912:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:1.0:1787604160.510935:0:3452:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0a0c0c04a80 x1874438316584192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604160.510949:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3452:1874438316584192:0@lo:400:kworker.0 00000100:00080000:0.0:1787604160.510952:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787604160.510959:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787604160.513658:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316583552 00000100:00100000:2.0:1787604160.513680:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316583552 00000100:00100000:2.0:1787604160.513774:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787604160.513786:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3452:x1874438316583552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604160.513904:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3452:x1874438316583552:12345-0@lo:400:kworker.0 Request processed in 120us (5013us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604160.513911:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787604160.514100:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316583552:0@lo:400:kworker.0 00000100:00100000:0.0:1787604160.747655:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604160.747794:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604160.747838:0:16389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299729152 00000100:00100000:0.0:1787604160.747852:0:16389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299729152 00000100:00100000:0.0:1787604160.747915:0:16389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 176 00000100:00100000:0.0:1787604160.747928:0:16389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c1779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8312a58-502b-4128-8f8b-3a527e86ed10+13:2390:x1874438299729152:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787604160.748016:0:16389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c1779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8312a58-502b-4128-8f8b-3a527e86ed10+13:2390:x1874438299729152:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 90us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604160.748034:0:16389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 176 00000100:00100000:0.0:1787604160.748073:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299729280 00000100:00100000:0.0:1787604160.748077:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299729280 00000100:00100000:0.0:1787604160.748116:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 100 00000100:00100000:0.0:1787604160.748122:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c1730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+11:2390:x1874438299729280:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787604160.748157:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c1730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+11:2390:x1874438299729280:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 35us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604160.748164:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 100 00000100:00080000:0.0:1787604160.748284:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787604160.762287:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604160.762415:0:16397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299729408 00000100:00100000:1.0:1787604160.762429:0:16397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299729408 00000100:00100000:1.0:1787604160.762521:0:16397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 101 00000100:00100000:1.0:1787604160.762534:0:16397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b6f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+5:2390:x1874438299729408:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787604160.762647:0:16397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b6f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+5:2390:x1874438299729408:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 115us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604160.762657:0:16397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 101 00000100:00080000:2.0:1787604160.762966:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787604160.772236:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604160.772299:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604160.772340:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604160.772541:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299729664 00000100:00100000:2.0:1787604160.772555:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299729664 00000100:00100000:2.0:1787604160.772633:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299729792 00000100:00100000:2.0:1787604160.772637:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299729792 00000100:00100000:2.0:1787604160.772675:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 102 00000100:00100000:2.0:1787604160.772713:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b6f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4505ec14-9a6c-40ba-9bbd-eece9d8c93ba+6:2390:x1874438299729664:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787604160.772813:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b6f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4505ec14-9a6c-40ba-9bbd-eece9d8c93ba+6:2390:x1874438299729664:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 127us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604160.772821:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 102 00000100:00100000:2.0:1787604160.772841:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 103 00000100:00100000:2.0:1787604160.772848:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4505ec14-9a6c-40ba-9bbd-eece9d8c93ba+5:2391:x1874438299729792:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787604160.772875:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4505ec14-9a6c-40ba-9bbd-eece9d8c93ba+5:2391:x1874438299729792:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 28us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604160.772881:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 103 00000100:00100000:1.0:1787604160.773365:0:18305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299729536 00000100:00100000:1.0:1787604160.773372:0:18305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299729536 00000100:00100000:1.0:1787604160.773423:0:18305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 40 00000100:00100000:1.0:1787604160.773432:0:18305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b6f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+6:2390:x1874438299729536:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787604160.773478:0:18305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b6f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+6:2390:x1874438299729536:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 48us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604160.773485:0:18305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 40 00000100:00080000:3.0:1787604160.773756:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787604160.773762:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787604160.773764:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1787604160.890284:0:20051:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 16:42:39 (1787604159) 00000040:00080000:3.0:1787604161.079380:0:16431:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787604161.079392:0:16431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787604161.079443:0:16431:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787604161.079461:0:16431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787604161.337143:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604162.360739:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604162.553341:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316584320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787604162.553466:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604162.553975:0:19470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316584320 00000100:00100000:1.0:1787604162.553987:0:19470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316584320 00000100:00100000:1.0:1787604162.554074:0:19470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787604162.554088:0:19470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c1733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316584320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787604162.554138:0:19470:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787604162.554210:0:19470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c1733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316584320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (744us total) trans 0 rc 0/0 00000100:00080000:3.0:1787604162.554358:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787604162.554441:0:19470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787604162.554593:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316584320:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787604163.381918:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604163.574004:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c1732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316584448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787604163.574078:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604163.574263:0:16400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316584448 00000100:00100000:0.0:1787604163.574279:0:16400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316584448 00000100:00100000:0.0:1787604163.574334:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787604163.574344:0:16400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316584448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787604163.574385:0:16400:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787604163.574432:0:16400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316584448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604163.574439:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787604163.575248:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c1733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3452:1874438316584576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787604163.575297:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604163.575340:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316584576 00000100:00100000:0.0:1787604163.575345:0:17037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316584576 00000100:00100000:0.0:1787604163.575373:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787604163.575394:0:17037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c1732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3452:x1874438316584576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787604163.575422:0:17037:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787604163.575457:0:17037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c1732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3452:x1874438316584576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604163.575463:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787604163.575502:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c1733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3452:1874438316584576:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787604163.575606:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c1732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316584448:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1787604163.576017:0:17050:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787604164.409655:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604164.598724:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316584704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787604164.598794:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604164.598959:0:17712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316584704 00000100:00100000:1.0:1787604164.598967:0:17712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316584704 00000100:00100000:1.0:1787604164.599025:0:17712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787604164.599033:0:17712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316584704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787604164.599065:0:17712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787604164.599108:0:17712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316584704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604164.599115:0:17712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787604164.599300:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316584704:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787604164.599395:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787604165.248405:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604165.248503:0:16382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299729920 00000100:00100000:1.0:1787604165.248512:0:16382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299729920 00000100:00100000:1.0:1787604165.248576:0:16382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 3 00000100:00100000:1.0:1787604165.248587:0:16382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8312a58-502b-4128-8f8b-3a527e86ed10+13:2392:x1874438299729920:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787604165.248602:0:16382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604165.248622:0:16382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0813d2600/0x6c241a9cc41dcdd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646faea5 expref: 13 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604165.248639:0:16382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787604165.248744:0:16382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8312a58-502b-4128-8f8b-3a527e86ed10+12:2392:x1874438299729920:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 158us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604165.248752:0:16382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 3 00000100:00100000:1.0:1787604165.251613:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604165.251743:0:16381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299730048 00000100:00100000:2.0:1787604165.251753:0:16381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299730048 00000100:00100000:2.0:1787604165.251811:0:16381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 4 00000100:00100000:2.0:1787604165.251821:0:16381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0ae431450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8312a58-502b-4128-8f8b-3a527e86ed10+12:2393:x1874438299730048:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787604165.251836:0:16381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787604165.251855:0:16381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0bc44f800/0x6c241a9cc41dce9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646faf8c expref: 12 pid: 16390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604165.251875:0:16381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787604165.251922:0:16381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0ae431450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8312a58-502b-4128-8f8b-3a527e86ed10+11:2393:x1874438299730048:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 103us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604165.251929:0:16381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 4 00000100:00100000:2.0:1787604165.261633:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604165.261746:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604165.261972:0:16382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299730432 00000100:00100000:1.0:1787604165.261983:0:16382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299730432 00000100:00100000:1.0:1787604165.262056:0:16382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5 00000100:00100000:1.0:1787604165.262067:0:16382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89350000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8312a58-502b-4128-8f8b-3a527e86ed10+11:2393:x1874438299730432:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787604165.262093:0:16382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604165.262114:0:16382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09f89d22e00/0x6c241a9cc41dcde0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646faed6 expref: 11 pid: 16390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604165.262131:0:16382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787604165.262193:0:16382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89350000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8312a58-502b-4128-8f8b-3a527e86ed10+10:2393:x1874438299730432:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 128us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604165.262201:0:16382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5 00000100:00100000:0.0:1787604165.262682:0:17708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299730304 00000100:00100000:0.0:1787604165.262716:0:17708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299730304 00000100:00100000:0.0:1787604165.262758:0:17708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 32 00000100:00100000:0.0:1787604165.262767:0:17708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+6:2389:x1874438299730304:12345-192.168.203.16@tcp:9:umount.0 00000020:00000080:0.0:1787604165.262796:0:17708:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dce03 00000020:00010000:0.0:1787604165.262803:0:17708:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa09f888b9800: total 0 00000100:00080000:0.0:1787604165.262807:0:17708:0:(import.c:65:import_set_state_nolock()) ffffa09f888bf800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787604165.262851:0:17708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:0.0:1787604165.263092:0:17708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+4:2389:x1874438299730304:12345-192.168.203.16@tcp:9:umount.0 Request processed in 317us (1459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604165.263100:0:17708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 32 00000020:00010000:3.0:1787604165.263229:0:16384:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa09f888b9800: total 0 00010000:00010000:3.0:1787604165.263234:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604165.263269:0:16384:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa09f888b9800, canceled 0 locks, left on hash table 1. 00002000:00010000:3.0:1787604165.263300:0:16384:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787604165.263303:0:16384:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1787604165.263343:0:16384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db67a78d/0x6c241a9cc41dd160 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb065 expref: 3 pid: 18751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604165.263365:0:16384:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa09f888b9800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787604165.263375:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604165.263389:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604165.263391:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787604165.264108:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787604165.271896:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604165.271999:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299731328 00000100:00100000:0.0:1787604165.272010:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299731328 00000100:00100000:0.0:1787604165.272092:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 74 00000100:00100000:0.0:1787604165.272104:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f882f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+11:2389:x1874438299731328:12345-192.168.203.16@tcp:39:umount.0 00000020:00000080:0.0:1787604165.272136:0:16395:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dcdee 00000020:00010000:0.0:1787604165.272153:0:16395:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa09f8109a000: total 0 00000100:00080000:0.0:1787604165.272158:0:16395:0:(import.c:65:import_set_state_nolock()) ffffa09f81099800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787604165.272191:0:16395:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934635 00000100:00100000:0.0:1787604165.272547:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f882f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+10:2389:x1874438299731328:12345-192.168.203.16@tcp:39:umount.0 Request processed in 444us (659us total) trans 8589934636 rc 0/0 00000100:00100000:0.0:1787604165.272568:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 74 00000020:00010000:1.0:1787604165.272670:0:18752:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa09f8109a000: total 0 00010000:00010000:1.0:1787604165.272744:0:18752:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa09f8109a000, canceled 0 locks, left on hash table 6. 00010000:00010000:1.0:1787604165.272778:0:18752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0a082b24700) 00010000:00010000:1.0:1787604165.272781:0:18752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787604165.272789:0:18752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030a00/0x6c241a9cc41dced5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646faf9a expref: 9 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604165.272812:0:18752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0a08868e800) 00010000:00010000:1.0:1787604165.272814:0:18752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787604165.272819:0:18752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa09f89d23a00/0x6c241a9cc41dcf14 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fafa8 expref: 8 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604165.272831:0:18752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0a0b3829500) 00010000:00010000:1.0:1787604165.272833:0:18752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787604165.272836:0:18752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc44fe00/0x6c241a9cc41dceb9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646faf93 expref: 7 pid: 16397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604165.272863:0:18752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0a08b6c3400) 00010000:00010000:1.0:1787604165.272866:0:18752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787604165.272870:0:18752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030000/0x6c241a9cc41dcf99 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fafd2 expref: 6 pid: 18010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604165.272883:0:18752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0a0b3829800) 00010000:00010000:1.0:1787604165.272885:0:18752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787604165.272889:0:18752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a800/0x6c241a9cc41dd10c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb042 expref: 5 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604165.272902:0:18752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0a0b3829000) 00010000:00010000:1.0:1787604165.272905:0:18752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787604165.272908:0:18752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4ba00/0x6c241a9cc41dd0b1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb02d expref: 4 pid: 16397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604165.272919:0:18752:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa09f8109a000, canceled 6 locks, left on hash table 0. 00010000:00010000:1.0:1787604165.272931:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604165.272933:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604165.272935:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787604165.273298:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787604165.286141:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604165.286289:0:16397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299731456 00000100:00100000:2.0:1787604165.286298:0:16397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299731456 00000100:00100000:2.0:1787604165.286365:0:16397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 75 00000100:00100000:2.0:1787604165.286374:0:16397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c1733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+5:2389:x1874438299731456:12345-192.168.203.16@tcp:39:umount.0 00000100:00080000:3.0:1787604165.286458:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:2.0:1787604165.286778:0:16397:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dcdf5 00000100:00080000:2.0:1787604165.286795:0:16397:0:(import.c:65:import_set_state_nolock()) ffffa09f884b4800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787604165.286823:0:16397:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1787604165.287061:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604165.289327:0:16397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c1733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6+3:2389:x1874438299731456:12345-192.168.203.16@tcp:39:umount.0 Request processed in 2945us (3186us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787604165.289353:0:16397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 75 00010000:00010000:3.0:1787604165.430016:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604165.621882:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcf97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316584960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787604165.621889:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bc4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3450:1874438316584832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787604165.622063:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c1733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3453:1874438316585216:0@lo:400:kworker.0 00000100:00100000:2.0:1787604165.622120:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c1730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3452:1874438316585088:0@lo:400:kworker.0 00000100:00100000:3.0:1787604165.622976:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604165.623043:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bc4a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316585472:0@lo:400:kworker.0 00000100:00100000:3.0:1787604165.623072:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604165.623096:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcd63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316585984:0@lo:400:kworker.0 00000100:00100000:3.0:1787604165.623118:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604165.623137:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3451:1874438316586496:0@lo:400:kworker.0 00000100:00100000:3.0:1787604165.623181:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604165.623205:0:3451:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787604165.623211:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c1732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316585344:0@lo:400:kworker.0 00000100:00100000:3.0:1787604165.623233:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604165.623253:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcd62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316585856:0@lo:400:kworker.0 00000100:00100000:3.0:1787604165.623285:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604165.623303:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3451:1874438316586368:0@lo:400:kworker.0 00000100:00100000:3.0:1787604165.623323:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604165.623621:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316585472 00000100:00100000:3.0:1787604165.623642:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316585472 00000100:00100000:3.0:1787604165.623718:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316585984 00000100:00100000:3.0:1787604165.623722:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316585984 00000100:00100000:3.0:1787604165.623735:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316585344 00000100:00100000:3.0:1787604165.623738:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316585344 00000100:00100000:3.0:1787604165.623750:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316585856 00000100:00100000:3.0:1787604165.623753:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316585856 00000100:00100000:3.0:1787604165.623771:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787604165.623787:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89e0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3451:x1874438316585472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604165.623843:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89e0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3451:x1874438316585472:12345-0@lo:400:kworker.0 Request processed in 63us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604165.623850:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787604165.623866:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787604165.623873:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89e09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316585984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604165.630563:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89e09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316585984:12345-0@lo:400:kworker.0 Request processed in 6680us (7434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604165.630578:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787604165.630612:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787604165.630625:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0f29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3451:x1874438316585344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604165.630673:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0f29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3451:x1874438316585344:12345-0@lo:400:kworker.0 Request processed in 55us (7440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604165.630679:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787604165.630711:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787604165.630717:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604165.630723:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0f29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316585856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604165.630760:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0f29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316585856:12345-0@lo:400:kworker.0 Request processed in 40us (7473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604165.630766:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787604165.630810:0:18010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316586496 00000100:00100000:3.0:1787604165.630819:0:18010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316586496 00000100:00100000:1.0:1787604165.630850:0:17712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316584960 00000100:00100000:3.0:1787604165.630856:0:18010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316586368 00000100:00100000:1.0:1787604165.630857:0:17712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316584960 00000100:00100000:3.0:1787604165.630862:0:18010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316586368 00000100:00100000:3.0:1787604165.630892:0:18010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787604165.630897:0:17712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316584832 00000100:00100000:1.0:1787604165.630902:0:17712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316584832 00000100:00100000:3.0:1787604165.630907:0:18010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3451:x1874438316586496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604165.630921:0:17712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787604165.630930:0:17712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89e08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3451:x1874438316584960:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787604165.630948:0:18010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3451:x1874438316586496:12345-0@lo:400:kworker.0 Request processed in 48us (7764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604165.630954:0:18010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00002000:00000024:1.0:1787604165.630968:0:17712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787604165.630969:0:18010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787604165.630980:0:18010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3451:x1874438316586368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604165.631013:0:17712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89e08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3451:x1874438316584960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (8039us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604165.631021:0:17712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787604165.631026:0:18010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3451:x1874438316586368:12345-0@lo:400:kworker.0 Request processed in 46us (7699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604165.631034:0:18010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787604165.631041:0:17712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787604165.631050:0:17712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1874438316584832:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787604165.631055:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787604165.631059:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787604165.631062:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787604165.631063:0:17712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787604165.631066:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787604165.631106:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c1732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316585344:0@lo:400:kworker.0 00000100:00100000:1.0:1787604165.631190:0:17712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1874438316584832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604165.631197:0:17712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787604165.631237:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bc4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3450:1874438316584832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787604165.631403:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604165.631439:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bc85d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316585728:0@lo:400:kworker.0 00000100:00100000:0.0:1787604165.631471:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604165.631489:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7790700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3453:1874438316586240:0@lo:400:kworker.0 00000100:00100000:0.0:1787604165.631511:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604165.631552:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316585216 00000100:00100000:0.0:1787604165.631556:0:17037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316585216 00000100:00100000:0.0:1787604165.631584:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316585728 00000100:00100000:0.0:1787604165.631587:0:17037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316585728 00000100:00100000:0.0:1787604165.631601:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787604165.631606:0:17037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1874438316585216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604165.631645:0:17037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1874438316585216:12345-0@lo:400:kworker.0 Request processed in 38us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604165.631651:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787604165.631664:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787604165.631670:0:17037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316585728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604165.631718:0:17037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316585728:12345-0@lo:400:kworker.0 Request processed in 48us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604165.631724:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787604165.631745:0:18010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316586240 00000100:00100000:0.0:1787604165.631748:0:18010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316586240 00000100:00100000:0.0:1787604165.631780:0:18010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787604165.631787:0:18010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3453:x1874438316586240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604165.631829:0:18010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3453:x1874438316586240:12345-0@lo:400:kworker.0 Request processed in 42us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604165.631835:0:18010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1787604165.631849:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787604165.631876:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c1733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3453:1874438316585216:0@lo:400:kworker.0 00000100:00100000:0.0:1787604165.631889:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bc85d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316585728:0@lo:400:kworker.0 00000100:00100000:0.0:1787604165.631899:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7790700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3453:1874438316586240:0@lo:400:kworker.0 00000100:00100000:3.0:1787604165.632070:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcd62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316585856:0@lo:400:kworker.0 00010000:00080000:3.0:1787604165.632083:0:3451:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0a0b7791c00 x1874438316586368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604165.632094:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3451:1874438316586368:0@lo:400:kworker.0 00000100:00100000:3.0:1787604165.632104:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bc4a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316585472:0@lo:400:kworker.0 00000100:00100000:3.0:1787604165.632115:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcd63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316585984:0@lo:400:kworker.0 00000100:00100000:3.0:1787604165.632236:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3451:1874438316586496:0@lo:400:kworker.0 00000100:00100000:3.0:1787604165.632305:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcf97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316584960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787604165.632435:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604165.632472:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bc4a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3452:1874438316585600:0@lo:400:kworker.0 00000100:00100000:2.0:1787604165.632500:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604165.632526:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3452:1874438316586112:0@lo:400:kworker.0 00000100:00100000:2.0:1787604165.632547:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604165.632563:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7790a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3452:1874438316586624:0@lo:400:kworker.0 00000100:00100000:2.0:1787604165.632582:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604165.632619:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316585600 00000100:00100000:2.0:1787604165.632623:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316585600 00000100:00100000:2.0:1787604165.632645:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316586112 00000100:00100000:2.0:1787604165.632648:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316586112 00000100:00100000:2.0:1787604165.632659:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316586624 00000100:00100000:2.0:1787604165.632660:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316586624 00000100:00100000:2.0:1787604165.632677:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787604165.632683:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc4a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3452:x1874438316585600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604165.632741:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc4a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3452:x1874438316585600:12345-0@lo:400:kworker.0 Request processed in 58us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604165.632747:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787604165.632761:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787604165.632767:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc4a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3452:x1874438316586112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604165.632794:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc4a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3452:x1874438316586112:12345-0@lo:400:kworker.0 Request processed in 27us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604165.632799:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787604165.632821:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787604165.632826:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3452:x1874438316586624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604165.632855:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3452:x1874438316586624:12345-0@lo:400:kworker.0 Request processed in 28us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604165.632860:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787604165.632885:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bc4a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3452:1874438316585600:0@lo:400:kworker.0 00000100:00100000:2.0:1787604165.632894:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3452:1874438316586112:0@lo:400:kworker.0 00010000:00080000:2.0:1787604165.632903:0:3452:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0a0b7790a80 x1874438316586624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787604165.632912:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7790a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3452:1874438316586624:0@lo:400:kworker.0 00000100:00100000:0.0:1787604165.632986:0:16388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316585088 00000100:00100000:0.0:1787604165.632990:0:16388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316585088 00000100:00100000:0.0:1787604165.633023:0:16388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787604165.633030:0:16388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bd26c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449a3e36-c3ea-43c4-8436-5c48a977c3d4+24:3452:x1874438316585088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604165.633066:0:16388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bd26c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449a3e36-c3ea-43c4-8436-5c48a977c3d4+24:3452:x1874438316585088:12345-0@lo:400:kworker.0 Request processed in 36us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604165.633072:0:16388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:0.0:1787604165.633096:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787604165.633390:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c1730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3452:1874438316585088:0@lo:400:kworker.0 00000100:00100000:0.0:1787604165.865620:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604165.865666:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604165.868727:0:18010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299731584 00000100:00100000:1.0:1787604165.868743:0:18010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299731584 00000100:00100000:1.0:1787604165.868833:0:18010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299731712 00000100:00100000:1.0:1787604165.868836:0:18010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299731712 00000100:00100000:1.0:1787604165.868872:0:18010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 110 00000100:00100000:1.0:1787604165.868884:0:18010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4505ec14-9a6c-40ba-9bbd-eece9d8c93ba+6:2390:x1874438299731584:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787604165.868951:0:16397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 111 00000100:00100000:3.0:1787604165.868961:0:16397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4505ec14-9a6c-40ba-9bbd-eece9d8c93ba+5:2390:x1874438299731712:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787604165.868968:0:18010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4505ec14-9a6c-40ba-9bbd-eece9d8c93ba+6:2390:x1874438299731584:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 87us (3359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604165.868976:0:18010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 110 00000100:00100000:3.0:1787604165.869006:0:16397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4505ec14-9a6c-40ba-9bbd-eece9d8c93ba+5:2390:x1874438299731712:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 48us (3340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604165.869012:0:16397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 111 00000100:00080000:0.0:1787604165.869167:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787604165.869172:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787604166.453919:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604167.251153:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604167.251203:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604167.251254:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604167.251316:0:16382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299731840 00000100:00100000:1.0:1787604167.251330:0:16382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299731840 00000100:00100000:1.0:1787604167.251406:0:16382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299731968 00000100:00100000:1.0:1787604167.251409:0:16382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299731968 00000100:00100000:1.0:1787604167.251421:0:16382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299732096 00000100:00100000:1.0:1787604167.251424:0:16382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299732096 00000100:00100000:1.0:1787604167.251466:0:16382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6 00000100:00100000:1.0:1787604167.251484:0:16382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0f2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8312a58-502b-4128-8f8b-3a527e86ed10+12:2393:x1874438299731840:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787604167.251506:0:16382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604167.251534:0:16382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0bc44ea00/0x6c241a9cc41dce1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646faf46 expref: 12 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604167.251559:0:16382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787604167.251643:0:16382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0f2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8312a58-502b-4128-8f8b-3a527e86ed10+11:2393:x1874438299731840:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 162us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604167.251651:0:16382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6 00000100:00100000:1.0:1787604167.251670:0:16382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:1.0:1787604167.251677:0:16382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0f28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8312a58-502b-4128-8f8b-3a527e86ed10+10:2393:x1874438299731968:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787604167.251741:0:16382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604167.251753:0:16382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0bc44ec00/0x6c241a9cc41dce18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646faf15 expref: 10 pid: 16390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604167.251764:0:16382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787604167.251784:0:16381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 8 00000100:00100000:1.0:1787604167.251786:0:16382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0f28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8312a58-502b-4128-8f8b-3a527e86ed10+9:2393:x1874438299731968:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 109us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604167.251795:0:16382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:0.0:1787604167.251802:0:16381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8312a58-502b-4128-8f8b-3a527e86ed10+9:2392:x1874438299732096:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787604167.251814:0:16381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787604167.251836:0:16381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a080031200/0x6c241a9cc41dce96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646faf85 expref: 8 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604167.251863:0:16381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787604167.251888:0:16381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8312a58-502b-4128-8f8b-3a527e86ed10+7:2392:x1874438299732096:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 94us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604167.251894:0:16381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 8 00000100:00100000:1.0:1787604167.259803:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604167.259865:0:18010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299732352 00000100:00100000:0.0:1787604167.259878:0:18010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299732352 00000100:00100000:0.0:1787604167.259960:0:18010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 76 00000100:00100000:0.0:1787604167.259974:0:18010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4505ec14-9a6c-40ba-9bbd-eece9d8c93ba+6:2389:x1874438299732352:12345-192.168.203.16@tcp:39:umount.0 00000100:00080000:2.0:1787604167.260024:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1787604167.260039:0:18010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dce2d 00000020:00010000:0.0:1787604167.260049:0:18010:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa0a0bc130000: total 0 00000100:00080000:0.0:1787604167.260055:0:18010:0:(import.c:65:import_set_state_nolock()) ffffa09f88380800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787604167.260094:0:18010:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00100000:0.0:1787604167.260402:0:18010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4505ec14-9a6c-40ba-9bbd-eece9d8c93ba+5:2389:x1874438299732352:12345-192.168.203.16@tcp:39:umount.0 Request processed in 430us (614us total) trans 8589934637 rc 0/0 00000100:00100000:0.0:1787604167.260412:0:18010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 76 00000020:00010000:3.0:1787604167.261397:0:16383:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa0a0bc130000: total 0 00010000:00010000:3.0:1787604167.261463:0:16383:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa0a0bc130000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787604167.261509:0:16383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0a08868e800) 00010000:00010000:3.0:1787604167.261513:0:16383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787604167.261523:0:16383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d2a00/0x6c241a9cc41dcf22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fafaf expref: 4 pid: 16397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604167.261549:0:16383:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa0a0bc130000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787604167.261561:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604167.261563:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604167.261564:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604167.272054:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604167.272319:0:16397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299732480 00000100:00100000:3.0:1787604167.272333:0:16397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299732480 00000100:00100000:3.0:1787604167.272505:0:16397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 77 00000100:00100000:3.0:1787604167.272519:0:16397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4505ec14-9a6c-40ba-9bbd-eece9d8c93ba+5:2389:x1874438299732480:12345-192.168.203.16@tcp:39:umount.0 00000020:00000080:3.0:1787604167.272607:0:16397:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dce34 00000100:00080000:3.0:1787604167.272619:0:16397:0:(import.c:65:import_set_state_nolock()) ffffa09f88832000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787604167.272660:0:16397:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:1.0:1787604167.272917:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604167.272950:0:16397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4505ec14-9a6c-40ba-9bbd-eece9d8c93ba+3:2389:x1874438299732480:12345-192.168.203.16@tcp:39:umount.0 Request processed in 432us (908us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787604167.272960:0:16397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 77 00000100:00080000:2.0:1787604167.275240:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787604167.317680:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604167.318079:0:16390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299732736 00000100:00100000:0.0:1787604167.318093:0:16390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299732736 00000100:00100000:0.0:1787604167.318169:0:16390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 178 00000100:00100000:0.0:1787604167.318184:0:16390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bd26cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8312a58-502b-4128-8f8b-3a527e86ed10+7:2389:x1874438299732736:12345-192.168.203.16@tcp:251:umount.0 00000020:00000080:0.0:1787604167.318241:0:16390:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dcdcb 00000020:00010000:0.0:1787604167.318261:0:16390:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa09f888be000: total 0 00000100:00080000:0.0:1787604167.318267:0:16390:0:(import.c:65:import_set_state_nolock()) ffffa09f888ba000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787604167.318656:0:16390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bd26cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8312a58-502b-4128-8f8b-3a527e86ed10+3:2389:x1874438299732736:12345-192.168.203.16@tcp:251:umount.0 Request processed in 473us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604167.318667:0:16390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 178 00000020:00010000:1.0:1787604167.322066:0:18752:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa09f888be000: total 0 00010000:00010000:1.0:1787604167.322080:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604167.322155:0:18752:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa09f888be000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787604167.322206:0:18752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0bc44fa00/0x6c241a9cc41dcdd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fae9e expref: 2 pid: 16390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604167.322261:0:18752:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa09f888be000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787604167.323670:0:18752:0:(genops.c:885:class_export_put()) final put ffffa09f888be000/c8312a58-502b-4128-8f8b-3a527e86ed10 00010000:00010000:1.0:1787604167.323728:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604167.323731:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604167.325558:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787604167.325963:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f888be000/c8312a58-502b-4128-8f8b-3a527e86ed10 for MGS 00000020:00000080:0.0:1787604167.326061:0:492:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa09f888ba000 for MGS 00010000:00010000:2.0:1787604167.485126:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604167.670146:0:3452:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787604167.670185:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcb49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316586752:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787604167.670293:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604167.670465:0:17712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316586752 00000100:00100000:1.0:1787604167.670477:0:17712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316586752 00000100:00100000:3.0:1787604167.670620:0:19470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787604167.670638:0:19470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3452:x1874438316586752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787604167.670719:0:19470:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787604167.670720:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787604167.670799:0:19470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3452:x1874438316586752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 166us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604167.670808:0:19470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787604167.670868:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcb49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316586752:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1787604168.268121:0:6460:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4505ec14-9a6c-40ba-9bbd-eece9d8c93ba 00000001:00080000:0.0:1787604168.268139:0:6460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:0.0:1787604168.268144:0:6460:0:(genops.c:885:class_export_put()) final put ffffa0a0bc130000/4505ec14-9a6c-40ba-9bbd-eece9d8c93ba 00000001:00100000:0.0:1787604168.268170:0:6460:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6 00000001:00080000:0.0:1787604168.268175:0:6460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00000080:0.0:1787604168.268177:0:6460:0:(genops.c:885:class_export_put()) final put ffffa09f8109a000/36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6 00000020:00000080:3.0:1787604168.268210:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0bc130000/4505ec14-9a6c-40ba-9bbd-eece9d8c93ba for lustre-MDT0000 00000020:00000080:3.0:1787604168.268431:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f8109a000/36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6 for lustre-MDT0000 00000020:00000080:3.0:1787604168.268483:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa09f88380800 for lustre-MDT0000 00000020:00000080:3.0:1787604168.268489:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa09f81099800 for lustre-MDT0000 00010000:00010000:3.0:1787604168.504958:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604168.694830:0:3451:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787604168.694861:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bc4a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316586880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787604168.694965:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604168.696842:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcb49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316587008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787604168.696923:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604168.697320:0:16401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316586880 00000100:00100000:0.0:1787604168.697330:0:16401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316586880 00000100:00100000:0.0:1787604168.697432:0:16401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316587008 00000100:00100000:0.0:1787604168.697436:0:16401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316587008 00000100:00100000:2.0:1787604168.697478:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787604168.697491:0:16400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc4a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316586880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787604168.697542:0:16400:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787604168.697613:0:16400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc4a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316586880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (2658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604168.697637:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787604168.697658:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787604168.697665:0:16400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0c06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3451:x1874438316587008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787604168.697716:0:16400:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787604168.697751:0:16400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0c06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3451:x1874438316587008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604168.697758:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787604168.697860:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcb49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316587008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787604168.697878:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bc4a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316586880:0@lo:41:osp-pre-0-1.0 00000020:01000004:0.0:1787604169.364175:0:20249:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1787604169.383984:0:20249:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787604169.384048:0:20249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e200/0x6c241a9cc41dc98e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dc995 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604169.384065:0:20249:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e200/0x6c241a9cc41dc98e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dc995 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604169.384074:0:20249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e200/0x6c241a9cc41dc98e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dc995 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604169.384081:0:20249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e200/0x6c241a9cc41dc98e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dc995 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604169.384105:0:20249:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787604169.384111:0:20249:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787604169.384339:0:20249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787604169.384345:0:20249:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787604169.384352:0:20249:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787604169.384384:0:20249:0:(import.c:65:import_set_state_nolock()) ffffa09f841eb000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787604169.384533:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3449:1874438316587136:0@lo:39:umount.0 00000100:00100000:2.0:1787604169.384614:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604169.384780:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316587136 00000100:00100000:3.0:1787604169.384790:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316587136 00000100:00100000:3.0:1787604169.384847:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787604169.384855:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1874438316587136:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787604169.384884:0:16396:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dc9bf 00000100:00080000:3.0:1787604169.384893:0:16396:0:(import.c:65:import_set_state_nolock()) ffffa09f8a758000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787604169.384963:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3449:x1874438316587136:12345-0@lo:39:umount.0 Request processed in 108us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604169.384971:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000020:00000080:3.0:1787604169.384981:0:16396:0:(genops.c:885:class_export_put()) final put ffffa09f8a75a000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1787604169.385005:0:16383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787604169.385012:0:16383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e200/0x6c241a9cc41dc98e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dc995 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604169.385022:0:16383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc44e200 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:3.0:1787604169.385026:0:16383:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e200/0x6c241a9cc41dc98e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dc995 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604169.385036:0:16383:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e200/0x6c241a9cc41dc98e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c241a9cc41dc995 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787604169.385044:0:16383:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e200/0x6c241a9cc41dc98e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c241a9cc41dc995 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787604169.385050:0:16383:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787604169.385053:0:16383:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787604169.385055:0:16383:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787604169.385082:0:16383:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e200/0x6c241a9cc41dc98e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dc995 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604169.385089:0:16383:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787604169.385109:0:16383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e200/0x6c241a9cc41dc98e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dc995 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604169.385127:0:16383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e200/0x6c241a9cc41dc98e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dc995 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604169.385152:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604169.385154:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604169.385155:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787604169.385165:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f8a75a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787604169.385215:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa09f8a758000 for lustre-MDT0000 00000100:00100000:3.0:1787604169.385237:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bc4a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3452:1874438316587264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787604169.385269:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604169.385315:0:16382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316587264 00000100:00100000:3.0:1787604169.385318:0:16382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316587264 00000100:00100000:3.0:1787604169.385349:0:16382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787604169.385355:0:16382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcd63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:449a3e36-c3ea-43c4-8436-5c48a977c3d4+24:3452:x1874438316587264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787604169.385376:0:16382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787604169.385390:0:16382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0b73bf000/0x6c241a9cc41dc995 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c241a9cc41dc98e expref: 24 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604169.385403:0:16382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787604169.385603:0:16382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcd63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:449a3e36-c3ea-43c4-8436-5c48a977c3d4+23:3452:x1874438316587264:12345-0@lo:103:ldlm_bl.0 Request processed in 247us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604169.385610:0:16382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787604169.385646:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bc4a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3452:1874438316587264:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787604169.386076:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f841eb000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787604169.386092:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3449:1874438316587136:0@lo:39:umount.0 00000100:00080000:0.0:1787604169.386176:0:20249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787604169.386180:0:20249:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787604169.386184:0:20249:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787604169.387418:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604169.387633:0:20249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0b73be800/0x6c241a9cc41dc8df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dc8e6 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604169.387653:0:20249:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0b73be800/0x6c241a9cc41dc8df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dc8e6 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604169.387661:0:20249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0b73be800/0x6c241a9cc41dc8df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dc8e6 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604169.387669:0:20249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0a0b73be800/0x6c241a9cc41dc8df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dc8e6 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604169.387998:0:20249:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604169.388009:0:20249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a083e4ae00/0x6c241a9cc41dcc27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dcc2e expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604169.388019:0:20249:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a083e4ae00/0x6c241a9cc41dcc27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dcc2e expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604169.388020:0:16384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604169.388041:0:20249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a083e4ae00/0x6c241a9cc41dcc27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dcc2e expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604169.388042:0:16384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0a0b73be800/0x6c241a9cc41dc8df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dc8e6 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604169.388071:0:20249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0a083e4ae00/0x6c241a9cc41dcc27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dcc2e expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604169.388074:0:16384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0b73be800 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:1.0:1787604169.388086:0:16384:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0a0b73be800/0x6c241a9cc41dc8df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dc8e6 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604169.388099:0:16384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0a0b73be800/0x6c241a9cc41dc8df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c241a9cc41dc8e6 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787604169.388107:0:16384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0a0b73be800/0x6c241a9cc41dc8df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c241a9cc41dc8e6 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787604169.388113:0:16384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787604169.388135:0:16384:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1787604169.388177:0:16384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0a0b73be800/0x6c241a9cc41dc8df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dc8e6 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604169.388184:0:16384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787604169.388201:0:20249:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604169.388212:0:20249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a080031c00/0x6c241a9cc41dce88 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dce8f expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604169.388241:0:16384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0a0b73be800/0x6c241a9cc41dc8df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dc8e6 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604169.388246:0:20249:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a080031c00/0x6c241a9cc41dce88 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dce8f expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604169.388255:0:16384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0a0b73be800/0x6c241a9cc41dc8df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dc8e6 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604169.388259:0:20249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a080031c00/0x6c241a9cc41dce88 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dce8f expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604169.388286:0:20249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0a080031c00/0x6c241a9cc41dce88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dce8f expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604169.388296:0:16384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787604169.388303:0:16384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0a083e4ae00/0x6c241a9cc41dcc27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dcc2e expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604169.388358:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3453:1874438316587392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787604169.388427:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787604169.388560:0:16384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a083e4ae00 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:1.0:1787604169.388564:0:16384:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0a083e4ae00/0x6c241a9cc41dcc27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dcc2e expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604169.388571:0:16384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0a083e4ae00/0x6c241a9cc41dcc27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c241a9cc41dcc2e expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787604169.388578:0:16384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0a083e4ae00/0x6c241a9cc41dcc27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c241a9cc41dcc2e expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787604169.388583:0:16384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787604169.388585:0:16384:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787604169.388587:0:16384:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787604169.388606:0:16384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0a083e4ae00/0x6c241a9cc41dcc27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dcc2e expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604169.388612:0:16384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787604169.388639:0:16384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0a083e4ae00/0x6c241a9cc41dcc27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dcc2e expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604169.388645:0:16384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0a083e4ae00/0x6c241a9cc41dcc27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dcc2e expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604169.388655:0:16384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787604169.388658:0:16384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0a080031c00/0x6c241a9cc41dce88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dce8f expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604169.388663:0:16384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a080031c00 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:1.0:1787604169.388666:0:16384:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0a080031c00/0x6c241a9cc41dce88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dce8f expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604169.388671:0:16384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0a080031c00/0x6c241a9cc41dce88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c241a9cc41dce8f expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787604169.388678:0:16384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0a080031c00/0x6c241a9cc41dce88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c241a9cc41dce8f expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787604169.388683:0:16384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787604169.388716:0:16384:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1787604169.388728:0:16384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0a080031c00/0x6c241a9cc41dce88 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dce8f expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604169.388734:0:16384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787604169.388739:0:16384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0a080031c00/0x6c241a9cc41dce88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dce8f expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604169.388747:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604169.388748:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604169.388819:0:16380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316587392 00000100:00100000:2.0:1787604169.388827:0:16380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316587392 00000100:00100000:2.0:1787604169.388876:0:16380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787604169.388885:0:16380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:449a3e36-c3ea-43c4-8436-5c48a977c3d4+23:3453:x1874438316587392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787604169.388897:0:16380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787604169.388911:0:16380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a083e4bc00/0x6c241a9cc41dc8e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c241a9cc41dc8df expref: 23 pid: 16390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604169.388921:0:16380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787604169.388958:0:16380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:449a3e36-c3ea-43c4-8436-5c48a977c3d4+22:3453:x1874438316587392:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604169.388965:0:16380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787604169.389003:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3450:1874438316587520:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787604169.389013:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604169.389036:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604169.389061:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787604169.389067:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3450:1874438316587648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787604169.389087:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604169.389118:0:16382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316587520 00000100:00100000:2.0:1787604169.389121:0:16382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316587520 00000100:00100000:2.0:1787604169.389141:0:16382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316587648 00000100:00100000:2.0:1787604169.389144:0:16382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316587648 00000100:00100000:2.0:1787604169.389161:0:16382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787604169.389167:0:16382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0ae430850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:449a3e36-c3ea-43c4-8436-5c48a977c3d4+23:3450:x1874438316587520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787604169.389173:0:16382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787604169.389182:0:16382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a083e4a000/0x6c241a9cc41dcc2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c241a9cc41dcc27 expref: 23 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604169.389190:0:16382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787604169.389212:0:16382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0ae430850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:449a3e36-c3ea-43c4-8436-5c48a977c3d4+22:3450:x1874438316587520:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604169.389218:0:16382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787604169.389269:0:16382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787604169.389275:0:16382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:449a3e36-c3ea-43c4-8436-5c48a977c3d4+21:3450:x1874438316587648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787604169.389282:0:16382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787604169.389290:0:16382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a080030600/0x6c241a9cc41dce8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c241a9cc41dce88 expref: 21 pid: 16390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604169.389299:0:16382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787604169.389320:0:16382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:449a3e36-c3ea-43c4-8436-5c48a977c3d4+20:3450:x1874438316587648:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604169.389336:0:16382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787604169.389370:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3450:1874438316587648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787604169.389377:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3450:1874438316587520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787604169.389400:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3453:1874438316587392:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787604169.389629:0:20249:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787604169.389640:0:20249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0a080031c00/0x6c241a9cc41dce88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dce8f expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787604169.389657:0:20249:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787604169.389670:0:20249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0b73be000/0x6c241a9cc41dc8d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dc8d8 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604169.389677:0:20249:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0b73be000/0x6c241a9cc41dc8d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dc8d8 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604169.389706:0:20249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0b73be000/0x6c241a9cc41dc8d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dc8d8 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604169.389714:0:20249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0a0b73be000/0x6c241a9cc41dc8d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dc8d8 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604169.389827:0:20249:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787604169.389832:0:20249:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787604169.389837:0:20249:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787604169.389886:0:20249:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787604169.389891:0:20249:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787604169.389896:0:20249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787604169.389901:0:20249:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:0.0:1787604169.389909:0:20249:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffffa09f88713000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787604169.389915:0:20249:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffffa09f89c3c000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787604169.389920:0:20249:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffffa09f889a1000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787604169.389924:0:20249:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffffa0a0bc112000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787604169.389930:0:20249:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffffa09f82083370) has exports, disconnecting them 00000020:00080000:0.0:1787604169.389934:0:20249:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa09f88713000), last request at 1787604165 00000020:00000080:0.0:1787604169.389943:0:20249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dcbf6 00000100:00080000:0.0:1787604169.389963:0:20249:0:(import.c:65:import_set_state_nolock()) ffffa09f88711000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787604169.390016:0:20249:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa09f88713000): rc 0 00000020:00000080:0.0:1787604169.390019:0:20249:0:(genops.c:885:class_export_put()) final put ffffa09f88713000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787604169.390034:0:20249:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa09f89c3c000), last request at 1787604165 00000020:00000080:0.0:1787604169.390037:0:20249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dcb5c 00000100:00080000:0.0:1787604169.390043:0:20249:0:(import.c:65:import_set_state_nolock()) ffffa09f89c3f000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787604169.390049:0:20249:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa09f89c3c000): rc 0 00000020:00000080:0.0:1787604169.390051:0:20249:0:(genops.c:885:class_export_put()) final put ffffa09f89c3c000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1787604169.390055:0:20249:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa09f889a1000), last request at 1787604091 00000020:00000080:0.0:1787604169.390058:0:20249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dcaad 00000100:00080000:0.0:1787604169.390061:0:20249:0:(import.c:65:import_set_state_nolock()) ffffa09f889a7000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787604169.390067:0:20249:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa09f889a1000): rc 0 00000020:00000080:0.0:1787604169.390069:0:20249:0:(genops.c:885:class_export_put()) final put ffffa09f889a1000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1787604169.390074:0:20249:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa0a0bc112000), last request at 1787604091 00000020:00000080:0.0:1787604169.390077:0:20249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dca44 00000100:00080000:0.0:1787604169.390080:0:20249:0:(import.c:65:import_set_state_nolock()) ffffa09f8895e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787604169.390087:0:20249:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00010000:00010000:2.0:1787604169.390635:0:16383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00080000:0.0:1787604169.390635:0:20249:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0a0bc112000): rc 0 00000004:00000080:0.0:1787604169.390647:0:20249:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb18e01a97ae0 00010000:00010000:2.0:1787604169.390649:0:16383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0a0b73be000/0x6c241a9cc41dc8d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dc8d8 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604169.390664:0:16383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0b73be000 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:2.0:1787604169.390669:0:16383:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0a0b73be000/0x6c241a9cc41dc8d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dc8d8 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787604169.390678:0:20249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00010000:00010000:2.0:1787604169.390680:0:16383:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0a0b73be000/0x6c241a9cc41dc8d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c241a9cc41dc8d8 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787604169.390705:0:16383:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0a0b73be000/0x6c241a9cc41dc8d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c241a9cc41dc8d8 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604169.390710:0:16383:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787604169.390713:0:16383:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787604169.390716:0:16383:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1787604169.390747:0:16383:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0a0b73be000/0x6c241a9cc41dc8d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dc8d8 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604169.390753:0:16383:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787604169.390773:0:16383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0a0b73be000/0x6c241a9cc41dc8d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dc8d8 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604169.390794:0:16383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0a0b73be000/0x6c241a9cc41dc8d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dc8d8 expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604169.390809:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604169.390810:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604169.390812:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604169.390820:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787604169.390834:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3453:1874438316587776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787604169.390884:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604169.390931:0:16382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316587776 00000100:00100000:2.0:1787604169.390937:0:16382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316587776 00000100:00100000:2.0:1787604169.390980:0:16382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787604169.390988:0:16382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:449a3e36-c3ea-43c4-8436-5c48a977c3d4+20:3453:x1874438316587776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787604169.390999:0:16382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787604169.391013:0:16382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a083e4ac00/0x6c241a9cc41dc8d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c241a9cc41dc8d1 expref: 20 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604169.391024:0:16382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787604169.391055:0:16382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:449a3e36-c3ea-43c4-8436-5c48a977c3d4+19:3453:x1874438316587776:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604169.391062:0:16382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787604169.391094:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3453:1874438316587776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787604169.391920:0:20249:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787604169.394208:0:20249:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787604169.394267:0:20249:0:(import.c:65:import_set_state_nolock()) ffffa0a0b7499000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1787604169.394600:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787604169.394617:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f88713000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787604169.394681:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f89c3c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787604169.394738:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f889a1000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787604169.394776:0:492:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa09f88711000 for lustre-MDT0000 00000020:00000080:3.0:1787604169.394800:0:492:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa09f89c3f000 for lustre-MDT0000 00000020:00000080:3.0:1787604169.394804:0:492:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa09f889a7000 for lustre-MDT0000 00000100:00100000:2.0:1787604169.395113:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316587904:0@lo:39:umount.0 00000100:00100000:2.0:1787604169.395187:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787604169.395674:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604169.395805:0:16400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316587904 00000100:00100000:3.0:1787604169.395818:0:16400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316587904 00000100:00100000:3.0:1787604169.395887:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787604169.395898:0:16400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3449:x1874438316587904:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787604169.395933:0:16400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dcad7 00000100:00080000:3.0:1787604169.395943:0:16400:0:(import.c:65:import_set_state_nolock()) ffffa0a086de2000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787604169.395971:0:16400:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1787604169.396241:0:16400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3449:x1874438316587904:12345-0@lo:39:umount.0 Request processed in 334us (1042us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1787604169.396250:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00010000:3.0:1787604169.396275:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787604169.396353:0:20249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787604169.396358:0:20249:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000100:00080000:1.0:1787604169.396362:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa0a0b7499000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787604169.396373:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316587904:0@lo:39:umount.0 00000004:00080000:0.0:1787604169.396586:0:20249:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787604169.396651:0:20249:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787604169.396674:0:20249:0:(import.c:65:import_set_state_nolock()) ffffa0a0c14ab800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787604169.396790:0:20249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787604169.396793:0:20249:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1787604169.396806:0:20249:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787604169.396848:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7790700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316588032:0@lo:9:umount.0 00000100:00080000:0.0:1787604169.396877:0:20249:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787604169.396892:0:20249:0:(import.c:65:import_set_state_nolock()) ffffa09f8a5ba800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787604169.396914:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1787604169.396953:0:20249:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffffa09f82083370) has no exports 00000100:00100000:1.0:1787604169.396967:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316588160:0@lo:9:umount.0 00000100:00100000:1.0:1787604169.396993:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604169.397816:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316588032 00000100:00100000:3.0:1787604169.397828:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316588032 00000100:00080000:2.0:1787604169.397902:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787604169.397904:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316588160 00000100:00100000:3.0:1787604169.397910:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316588160 00000100:00080000:2.0:1787604169.397938:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787604169.397951:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787604169.397971:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3449:x1874438316588032:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787604169.397998:0:18751:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dcc3c 00000100:00080000:3.0:1787604169.398009:0:18751:0:(import.c:65:import_set_state_nolock()) ffffa09f88835000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787604169.398032:0:18305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787604169.398052:0:18305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3449:x1874438316588160:12345-0@lo:9:umount.0 00000001:00000004:3.0:1787604169.398061:0:18751:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000020:00000080:1.0:1787604169.398086:0:18305:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dcc43 00000100:00080000:1.0:1787604169.398173:0:18305:0:(import.c:65:import_set_state_nolock()) ffffa09f88831800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787604169.398225:0:18305:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00010000:00010000:2.0:1787604169.398564:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604169.398601:0:18305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3449:x1874438316588160:12345-0@lo:9:umount.0 Request processed in 557us (1606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604169.398609:0:18305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1787604169.398631:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787604169.398657:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f8a5ba800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787604169.399579:0:3449:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787604169.399583:0:3449:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787604169.399589:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316588160:0@lo:9:umount.0 00000100:00100000:3.0:1787604169.403280:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3449:x1874438316588032:12345-0@lo:9:umount.0 Request processed in 5301us (6356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604169.403300:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1787604169.409088:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa0a0c14ab800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787604169.409124:0:3449:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787604169.409127:0:3449:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787604169.409136:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7790700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316588032:0@lo:9:umount.0 00000020:00080000:2.0:1787604169.417423:0:20249:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffffa09f82083370) has no exports 00000020:00000080:2.0:1787604169.481838:0:20249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dc92c 00000020:00000080:2.0:1787604169.481853:0:20249:0:(genops.c:885:class_export_put()) final put ffffa0a0bcfc0800/lustre-QMT0000_UUID 00000020:01000000:2.0:1787604169.481870:0:20249:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787604169.481970:0:20249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787604169.481988:0:20249:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787604169.481994:0:20249:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffffa0a0b77d4d28) has no exports 00000020:00000080:3.0:1787604169.482332:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0bcfc0800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787604169.483570:0:20249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dc925 00000020:00000080:0.0:1787604169.483583:0:20249:0:(genops.c:885:class_export_put()) final put ffffa0a0bcfc7000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787604169.483672:0:20249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787604169.483718:0:20249:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787604169.483723:0:20249:0:(genops.c:885:class_export_put()) final put ffffa0a0bcfc1800/lustre-QMT0000_UUID 00000020:00000080:0.0:1787604169.483726:0:20249:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0bcfc1800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787604169.483739:0:20249:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1787604169.484024:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0bcfc7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1787604169.527313:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604169.718300:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316588288:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787604169.718391:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604169.718461:0:17713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316588288 00000100:00100000:2.0:1787604169.718468:0:17713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316588288 00000100:00100000:2.0:1787604169.718543:0:17713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787604169.718554:0:17713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316588288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787604169.718590:0:17713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787604169.718650:0:17713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316588288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604169.718659:0:17713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1787604169.718727:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787604169.718793:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316588288:0@lo:13:osp-pre-1-1.0 00000001:00100000:2.0:1787604169.787805:0:7237:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6 00000001:00080000:2.0:1787604169.787831:0:7237:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:2.0:1787604169.787839:0:7237:0:(genops.c:885:class_export_put()) final put ffffa09f8109f000/36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6 00000001:00100000:2.0:1787604169.787869:0:7237:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787604169.787876:0:7237:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:2.0:1787604169.787878:0:7237:0:(genops.c:885:class_export_put()) final put ffffa09f8895f800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787604169.787884:0:7237:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 4505ec14-9a6c-40ba-9bbd-eece9d8c93ba 00000001:00080000:2.0:1787604169.787889:0:7237:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:2.0:1787604169.787891:0:7237:0:(genops.c:885:class_export_put()) final put ffffa09f88831000/4505ec14-9a6c-40ba-9bbd-eece9d8c93ba 00000020:00000080:0.0:1787604169.788169:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f8109f000/36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6 for lustre-MDT0001 00000020:00000080:0.0:1787604169.788259:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f8895f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1787604169.788311:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f88831000/4505ec14-9a6c-40ba-9bbd-eece9d8c93ba for lustre-MDT0001 00000020:00000080:0.0:1787604169.788333:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa09f884b4800 for lustre-MDT0001 00000020:00000080:0.0:1787604169.788338:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0a086de2000 for lustre-MDT0001 00000020:00000080:0.0:1787604169.788344:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa09f88832000 for lustre-MDT0001 00000001:00100000:0.0:1787604169.791613:0:9030:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6 00000020:00000080:0.0:1787604169.791625:0:9030:0:(genops.c:885:class_export_put()) final put ffffa09f888b9800/36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6 00000001:00100000:0.0:1787604169.791665:0:9030:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787604169.791668:0:9030:0:(genops.c:885:class_export_put()) final put ffffa09f88830000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787604169.791875:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f888b9800/36c0c9a5-4c72-42b9-b3a8-fff84a1c3ec6 for lustre-OST0001 00000020:00000080:3.0:1787604169.791937:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f88830000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787604169.791958:0:492:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa09f888bf800 for lustre-OST0001 00000020:00000080:3.0:1787604169.791964:0:492:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa09f88831800 for lustre-OST0001 00010000:00010000:2.0:1787604170.553143:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604170.742298:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3450:1874438316588416:0@lo:400:kworker.0 00000100:00100000:2.0:1787604170.742430:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604170.742446:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a086312680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316588672:0@lo:400:kworker.0 00000100:00100000:1.0:1787604170.742492:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcb49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316588544:0@lo:400:kworker.0 00000100:00100000:3.0:1787604170.742498:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604170.742504:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7271f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3450:1874438316588928:0@lo:400:kworker.0 00000100:00100000:3.0:1787604170.742531:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7273b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3452:1874438316589184:0@lo:400:kworker.0 00000100:00100000:1.0:1787604170.742544:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604170.742548:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604170.742584:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3450:1874438316589440:0@lo:400:kworker.0 00000100:00100000:3.0:1787604170.742585:0:16397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316588928 00000100:00100000:1.0:1787604170.742592:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3451:1874438316589056:0@lo:400:kworker.0 00000100:00100000:3.0:1787604170.742596:0:16397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316588928 00000100:00100000:2.0:1787604170.742617:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604170.742638:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a086313100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316588800:0@lo:400:kworker.0 00000100:00100000:3.0:1787604170.742647:0:16397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316589440 00000100:00100000:3.0:1787604170.742652:0:16397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316589440 00000100:00100000:2.0:1787604170.742670:0:16389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316588416 00000100:00100000:1.0:1787604170.742672:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604170.742676:0:16389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316588416 00000100:00100000:1.0:1787604170.742723:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7271500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3453:1874438316589312:0@lo:400:kworker.0 00000100:00100000:3.0:1787604170.742742:0:16397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787604170.742750:0:16389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787604170.742755:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604170.742757:0:16397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3450:x1874438316589440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604170.742765:0:16389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bd26e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449a3e36-c3ea-43c4-8436-5c48a977c3d4+19:3450:x1874438316588416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604170.742789:0:17710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316588672 00000100:00100000:1.0:1787604170.742794:0:17710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316588672 00000100:00100000:2.0:1787604170.742833:0:16389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bd26e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449a3e36-c3ea-43c4-8436-5c48a977c3d4+19:3450:x1874438316588416:12345-0@lo:400:kworker.0 Request processed in 70us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604170.742833:0:17710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316588800 00000100:00100000:3.0:1787604170.742834:0:16397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3450:x1874438316589440:12345-0@lo:400:kworker.0 Request processed in 81us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604170.742838:0:17710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316588800 00000100:00100000:3.0:1787604170.742852:0:16397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787604170.742854:0:16389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787604170.742866:0:17710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787604170.742877:0:16397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316589312 00000100:00100000:3.0:1787604170.742882:0:16397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316589312 00000100:00100000:1.0:1787604170.742890:0:17710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcd62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3452:x1874438316588672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604170.742901:0:16397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787604170.742908:0:16397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3450:x1874438316588928:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787604170.742917:0:16397:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787604170.742927:0:17708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787604170.742933:0:17710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcd62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3452:x1874438316588672:12345-0@lo:400:kworker.0 Request processed in 56us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604170.742940:0:17708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316588800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604170.742942:0:17710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787604170.742956:0:16397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3450:x1874438316588928:12345-0@lo:400:kworker.0 Request processed in 45us (407us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787604170.742963:0:16397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787604170.742980:0:16397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787604170.742985:0:16397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3453:x1874438316589312:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787604170.742990:0:16397:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787604170.742996:0:17708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316588800:12345-0@lo:400:kworker.0 Request processed in 59us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604170.743030:0:16397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3453:x1874438316589312:12345-0@lo:400:kworker.0 Request processed in 43us (278us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787604170.743037:0:16397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1787604170.743060:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787604170.743065:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787604170.743084:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604170.743110:0:17708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787604170.743129:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a086312680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316588672:0@lo:400:kworker.0 00000100:00100000:2.0:1787604170.743139:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604170.743161:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316589184 00000100:00100000:3.0:1787604170.743166:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316589184 00000100:00080000:2.0:1787604170.743193:0:3450:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1787604170.743200:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316589056 00000100:00080000:2.0:1787604170.743201:0:3450:0:(import.c:65:import_set_state_nolock()) ffffa0a086de1800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:1.0:1787604170.743201:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a086313100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316588800:0@lo:400:kworker.0 00000100:00100000:3.0:1787604170.743206:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316589056 00000100:02000400:2.0:1787604170.743210:0:3450:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787604170.743228:0:3453:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787604170.743233:0:3453:0:(import.c:65:import_set_state_nolock()) ffffa09f88830800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:3.0:1787604170.743238:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:02000400:1.0:1787604170.743247:0:3453:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1787604170.743251:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcd63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3452:x1874438316589184:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787604170.743255:0:3453:0:(import.c:65:import_set_state_nolock()) ffffa09f88830800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787604170.743262:0:3453:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 498 00000100:00080000:1.0:1787604170.743269:0:3453:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa09f88830800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1787604170.743293:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcd63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3452:x1874438316589184:12345-0@lo:400:kworker.0 Request processed in 45us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604170.743297:0:3453:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a0b7270700 x1874438316589568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787604170.743304:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787604170.743322:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787604170.743328:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7271500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3453:1874438316589312:0@lo:400:kworker.0 00000100:00100000:3.0:1787604170.743329:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3451:x1874438316589056:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787604170.743339:0:16396:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787604170.743368:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3449:1874438316589568:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1787604170.743397:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604170.743560:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3451:x1874438316589056:12345-0@lo:400:kworker.0 Request processed in 230us (421us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787604170.743567:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787604170.743579:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316589568 00000100:00100000:3.0:1787604170.743583:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316589568 00000100:00100000:3.0:1787604170.743599:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787604170.743604:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3449:x1874438316589568:12345-0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787604170.743610:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316588544 00000100:00100000:0.0:1787604170.743616:0:17037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316588544 00010000:02000000:3.0:1787604170.743623:0:16396:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787604170.743675:0:16401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787604170.743681:0:16401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3451:x1874438316588544:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787604170.743714:0:16401:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787604170.743739:0:16401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3451:x1874438316588544:12345-0@lo:400:kworker.0 Request processed in 58us (1197us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787604170.743763:0:16401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1787604170.743812:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787604170.743836:0:3451:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787604170.743840:0:3451:0:(import.c:65:import_set_state_nolock()) ffffa0a0888fc000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787604170.743843:0:3451:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787604170.743848:0:3451:0:(import.c:65:import_set_state_nolock()) ffffa0a0888fc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787604170.743851:0:3451:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 471 00000100:00080000:1.0:1787604170.743856:0:3451:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffffa0a0888fc000 using connection 192.168.203.116@tcp/0@lo 00010000:00080000:0.0:1787604170.743966:0:3452:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0a0b7273b80 x1874438316589184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604170.743987:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7273b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3452:1874438316589184:0@lo:400:kworker.0 00000100:00100000:1.0:1787604170.744348:0:3451:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a0b7272d80 x1874438316589696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787604170.744374:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcb49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316588544:0@lo:400:kworker.0 00000100:00080000:1.0:1787604170.744389:0:3451:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787604170.744393:0:3451:0:(import.c:65:import_set_state_nolock()) ffffa09f88317800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787604170.744396:0:3451:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787604170.744400:0:3451:0:(import.c:65:import_set_state_nolock()) ffffa09f88317800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787604170.744403:0:3451:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 484 00000100:00080000:1.0:1787604170.744417:0:3451:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa09f88317800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1787604170.744431:0:3451:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a0b7273100 x1874438316589824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787604170.744440:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3451:1874438316589056:0@lo:400:kworker.0 00000100:00100000:0.0:1787604170.744611:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7272d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3449:1874438316589696:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1787604170.744655:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604170.744711:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7273100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3449:1874438316589824:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1787604170.744736:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604170.744769:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316589824 00000100:00100000:0.0:1787604170.744774:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316589824 00000100:00100000:0.0:1787604170.744798:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787604170.744805:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3449:x1874438316589824:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1787604170.744819:0:16395:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787604170.744855:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3449:x1874438316589824:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 49us (118us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787604170.744862:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1787604170.744906:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f88317800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787604170.744918:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787604170.744922:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7273100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3449:1874438316589824:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1787604170.745530:0:16400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316589696 00000100:00100000:1.0:1787604170.745538:0:16400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316589696 00000100:00100000:1.0:1787604170.745575:0:16400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787604170.745581:0:16400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3449:x1874438316589696:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1787604170.745594:0:16400:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787604170.745637:0:16400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3449:x1874438316589696:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 56us (981us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787604170.745644:0:16400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1787604170.745735:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa0a0888fc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787604170.745739:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787604170.745743:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7272d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3449:1874438316589696:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1787604170.758584:0:3450:0:(import.c:65:import_set_state_nolock()) ffffa0a086de1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787604170.758597:0:3450:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 472 00000100:00080000:2.0:1787604170.758608:0:3450:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffffa0a086de1800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1787604170.758656:0:3450:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa09f89d92300 x1874438316589952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787604170.758736:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7271f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3450:1874438316588928:0@lo:400:kworker.0 00010000:00080000:2.0:1787604170.758777:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0a0b7271180 x1874438316589440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787604170.758790:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3450:1874438316589440:0@lo:400:kworker.0 00000100:00100000:2.0:1787604170.758802:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3450:1874438316588416:0@lo:400:kworker.0 00000100:00100000:0.0:1787604170.760168:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3449:1874438316589952:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1787604170.760282:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604170.760456:0:16397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316589952 00000100:00100000:1.0:1787604170.760465:0:16397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316589952 00000100:00100000:1.0:1787604170.760512:0:16397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787604170.760520:0:16397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc85d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3449:x1874438316589952:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1787604170.760541:0:16397:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787604170.760606:0:16397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc85d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3449:x1874438316589952:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 85us (325us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787604170.760614:0:16397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1787604170.762071:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa0a086de1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787604170.762081:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787604170.762086:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3449:1874438316589952:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787604170.788249:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3449:x1874438316589568:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 44628us (44836us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787604170.788269:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1787604170.790013:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f88830800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787604170.790055:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787604170.790063:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3449:1874438316589568:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:1.0:1787604171.573997:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787604171.816167:0:8099:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787604171.816180:0:8099:0:(genops.c:885:class_export_put()) final put ffffa09f88835800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787604171.816396:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f88835800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787604171.816826:0:492:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa09f88835000 for lustre-OST0000 00010000:00010000:2.0:1787604172.598189:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604172.790261:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316590080:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787604172.790380:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604172.794789:0:19470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316590080 00000100:00100000:1.0:1787604172.794811:0:19470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316590080 00000100:00100000:1.0:1787604172.794935:0:19470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787604172.794949:0:19470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316590080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787604172.795011:0:19470:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787604172.795124:0:19470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316590080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 178us (4743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604172.795146:0:19470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787604172.795621:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316590080:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787604172.796316:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1787604173.366446:0:6460:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787604173.366461:0:6460:0:(genops.c:885:class_export_put()) final put ffffa0a0bc112000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787604173.366669:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0bc112000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1787604173.366773:0:492:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa09f8895e800 for lustre-MDT0000 00010000:00010000:2.0:1787604173.622606:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787604173.814747:0:17050:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787604174.648822:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604174.838086:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7272a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316590208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787604174.838181:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604174.838281:0:17713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316590208 00000100:00100000:1.0:1787604174.838291:0:17713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316590208 00000100:00100000:1.0:1787604174.838356:0:17713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787604174.838367:0:17713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7271c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3452:x1874438316590208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787604174.838410:0:17713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787604174.838462:0:17713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7271c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3452:x1874438316590208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604174.838470:0:17713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1787604174.838493:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787604174.838535:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7272a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316590208:0@lo:13:osp-pre-1-1.0 00000020:01000000:0.0:1787604175.543761:0:20249:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa09f89398300 - data ffffa0a0a6688870/ffffa09f8916d400 00000020:01000000:0.0:1787604175.543946:0:20249:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0a08547dd80 - data ffffa0a0a6954bd0/ffffa0a08492e400 00000001:00000004:0.0:1787604175.553372:0:20249:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00010000:00010000:2.0:1787604175.671153:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787604175.694130:0:20249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787604175.694142:0:20249:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787604175.694162:0:20249:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffffa0a0b7791c00 x1874438316587904/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787604179 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604175.694207:0:20249:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787604175.702281:0:20249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787604175.702294:0:20249:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1787604175.702374:0:20249:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787604175.702379:0:20249:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787604175.705580:0:16419:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787604175.705589:0:16419:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1787604175.705607:0:16419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1787604175.712166:0:20249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787604175.712178:0:20249:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1787604175.712211:0:20249:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787604175.712215:0:20249:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787604175.714042:0:16421:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787604175.714051:0:16421:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:1.0:1787604175.714064:0:16421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1787604175.789232:0:20249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dc8f4 00000020:00000080:1.0:1787604175.789248:0:20249:0:(genops.c:885:class_export_put()) final put ffffa09f8a7a3800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787604175.789370:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f8a7a3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787604175.791399:0:20249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dc909 00000020:00000080:1.0:1787604175.791459:0:20249:0:(genops.c:885:class_export_put()) final put ffffa0a0b749a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787604175.791523:0:20249:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787604175.791531:0:20249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787604175.791542:0:20249:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787604175.791547:0:20249:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffffa09f820819b8) has no exports 00000004:01000000:1.0:1787604175.791888:0:20249:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787604175.791899:0:20249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dc96b 00000020:00000080:1.0:1787604175.791906:0:20249:0:(genops.c:885:class_export_put()) final put ffffa0a0ae463800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787604175.792070:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0b749a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787604175.792152:0:20249:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787604175.792158:0:20249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787604175.792165:0:20249:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787604175.792169:0:20249:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffffa0a0c115b370) has no exports 00000020:00000080:1.0:1787604175.792178:0:20249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dc964 00000020:00000080:1.0:1787604175.792193:0:20249:0:(genops.c:885:class_export_put()) final put ffffa0a088a25000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787604175.792210:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0ae463800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1787604175.792678:0:20249:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787604175.792683:0:20249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787604175.792715:0:20249:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:1.0:1787604175.792721:0:20249:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787604175.792724:0:20249:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787604175.792897:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a088a25000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787604175.793036:0:20249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787604175.793045:0:20249:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787604175.793052:0:20249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dc956 00000020:00000080:1.0:1787604175.793058:0:20249:0:(genops.c:885:class_export_put()) final put ffffa0a088a26000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787604175.793062:0:20249:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787604175.793066:0:20249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787604175.793070:0:20249:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787604175.793073:0:20249:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffffa09f899c99b8) has no exports 00000020:00000080:1.0:1787604175.793078:0:20249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dc94f 00000020:00000080:1.0:1787604175.793080:0:20249:0:(genops.c:885:class_export_put()) final put ffffa0a0c14a9000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1787604175.793465:0:20249:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787604175.793482:0:20249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787604175.793485:0:20249:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1787604175.793489:0:20249:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787604175.793491:0:20249:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787604175.793518:0:20249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787604175.793524:0:20249:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1787604175.793537:0:20249:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787604175.793544:0:20249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dc941 00000020:00000080:1.0:1787604175.793550:0:20249:0:(genops.c:885:class_export_put()) final put ffffa0a0b749f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787604175.793554:0:20249:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1787604175.793557:0:20249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787604175.793560:0:20249:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787604175.793562:0:20249:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffffa09f82084d28) has no exports 00000020:00000080:1.0:1787604175.793566:0:20249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dc93a 00000020:00000080:1.0:1787604175.793569:0:20249:0:(genops.c:885:class_export_put()) final put ffffa0a0b749e000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1787604175.794635:0:20249:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1787604175.794643:0:20249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787604175.794647:0:20249:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787604175.795303:0:20249:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787604175.795437:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa09f8a5ba800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787604175.795450:0:37:0:(genops.c:885:class_export_put()) final put ffffa0a088a24800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787604175.795454:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a088a24800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787604175.795471:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787604175.795571:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a088a26000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787604175.795580:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0c14a9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787604175.795586:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0a0c14ab800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787604175.795591:0:37:0:(genops.c:885:class_export_put()) final put ffffa0a0b749a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787604175.795594:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0b749a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787604175.795597:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787604175.795623:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0b749f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787604175.795628:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0b749e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787604175.796000:0:20249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787604175.796026:0:20249:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787604175.796057:0:20249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787604175.796073:0:20249:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787604175.796078:0:20249:0:(genops.c:885:class_export_put()) final put ffffa0a0c0f7d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787604175.796080:0:20249:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0c0f7d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787604175.796086:0:20249:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787604175.796253:0:20249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dc910 00000020:00000080:2.0:1787604175.796261:0:20249:0:(genops.c:885:class_export_put()) final put ffffa0a0b7498800/lustre-MDD0000_UUID 00000020:01000000:2.0:1787604175.796266:0:20249:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787604175.796270:0:20249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787604175.796275:0:20249:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787604175.796280:0:20249:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffffa09f82080000) has no exports 00000020:00000080:2.0:1787604175.796300:0:20249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787604175.796303:0:20249:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787604175.796308:0:20249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dc917 00000020:00000080:2.0:1787604175.796312:0:20249:0:(genops.c:885:class_export_put()) final put ffffa0a0b749b800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787604175.796322:0:20249:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0a0b74ab800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787604175.796325:0:20249:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0a0b74ab800 3 00000020:01000004:2.0:1787604175.796329:0:20249:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa0a0b74ab800 from lustre-MDT0000 00000020:00000080:2.0:1787604175.796351:0:20249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787604175.796354:0:20249:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787604175.796357:0:20249:0:(genops.c:885:class_export_put()) final put ffffa09f8a7a6000/lustre-MDT0000_UUID 00000020:00000080:2.0:1787604175.796359:0:20249:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f8a7a6000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787604175.796367:0:20249:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787604175.796394:0:20249:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1787604175.796398:0:20249:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787604175.796400:0:20249:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787604175.796403:0:20249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787604175.796406:0:20249:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787604175.796414:0:20249:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffffa0a0b7751000 449a3e36-c3ea-43c4-8436-5c48a977c3d4 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787604175.796420:0:20249:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffffa0a0b77d3370) has exports, disconnecting them 00000020:00080000:2.0:1787604175.796424:0:20249:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffffa0a0b7751000), last request at 1787604079 00000020:00000080:2.0:1787604175.796440:0:20249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dc8bc 00000020:00010000:2.0:1787604175.796444:0:20249:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa0a0b7751000: total 2 00000100:00080000:2.0:1787604175.796454:0:20249:0:(import.c:65:import_set_state_nolock()) ffffa0a0b7750000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787604175.796471:0:20249:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0a0b7751000): rc 0 00000020:00080000:2.0:1787604175.796475:0:20249:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffffa0a0b77d3370) has no exports 00000020:00010000:2.0:1787604175.796488:0:18752:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa0a0b7751000: total 2 00010000:00010000:2.0:1787604175.796509:0:18752:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa0a0b7751000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1787604175.796543:0:18752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a083e4be00/0x6c241a9cc41dcb1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c241a9cc41dcb16 expref: 14 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604175.796561:0:18752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0b73bf600/0x6c241a9cc41dce65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c241a9cc41dce5e expref: 13 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604175.796571:0:18752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0b73be400/0x6c241a9cc41dc9db lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c241a9cc41dc9d4 expref: 12 pid: 16390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604175.796585:0:18752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0bc44f000/0x6c241a9cc41dcbb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c241a9cc41dcbb0 expref: 11 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604175.796596:0:18752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0bc41aa00/0x6c241a9cc41dcb47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c241a9cc41dcb40 expref: 10 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604175.796606:0:18752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0b73bea00/0x6c241a9cc41dce73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c241a9cc41dce6c expref: 9 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604175.796615:0:18752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0bc41a200/0x6c241a9cc41dca98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c241a9cc41dca91 expref: 8 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604175.796626:0:18752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0b73bf800/0x6c241a9cc41dc9e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c241a9cc41dc9e2 expref: 7 pid: 16390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604175.796637:0:18752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0b73be600/0x6c241a9cc41dce81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c241a9cc41dce7a expref: 6 pid: 16388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604175.796660:0:18752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a083e4b400/0x6c241a9cc41dc9f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c241a9cc41dc9f0 expref: 5 pid: 16390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604175.796669:0:18752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0bc44f400/0x6c241a9cc41dc8ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c241a9cc41dc8c3 expref: 4 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604175.796678:0:18752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a083e4a600/0x6c241a9cc41dcbe1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c241a9cc41dcbda expref: 3 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604175.796716:0:18752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a083e4a400/0x6c241a9cc41dcc20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c241a9cc41dcc19 expref: 2 pid: 16389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604175.796726:0:18752:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa0a0b7751000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1787604175.796739:0:18752:0:(genops.c:885:class_export_put()) final put ffffa0a0b7751000/449a3e36-c3ea-43c4-8436-5c48a977c3d4 00010000:00010000:2.0:1787604175.796745:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604175.796747:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604175.796749:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604175.796985:0:16389:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffffa0a0c0f2d200:16389] 1 exiting: rc = 0 00000100:00100000:2.0:1787604175.797106:0:16388:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffffa09f882c1200:16388] 0 exiting: rc = 1 00000020:00000080:3.0:1787604175.797286:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0a0b7499000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787604175.797295:0:37:0:(genops.c:885:class_export_put()) final put ffffa0a0b749e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787604175.797306:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0b749e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1787604175.797313:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787604175.797366:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0b7498800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787604175.797371:0:37:0:(genops.c:885:class_export_put()) final put ffffa0a0b749c800/lustre-MDD0000_UUID 00000020:00000080:3.0:1787604175.797374:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0b749c800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787604175.797377:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787604175.797400:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0b749b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787604175.797405:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0b7751000/449a3e36-c3ea-43c4-8436-5c48a977c3d4 for MGS 00000020:00000080:3.0:1787604175.797439:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0a0b7750000 for MGS 00000100:00100000:0.0:1787604175.800664:0:16390:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffffa0a0b7bb5400:16390] 2 exiting: rc = 0 00000100:00100000:2.0:1787604175.800919:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.800932:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.800941:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.800951:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.800961:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.800969:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.800978:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.800990:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.800998:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801082:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801093:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801115:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801120:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801127:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801134:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801140:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801145:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801151:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801156:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801161:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801168:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801176:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801182:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801203:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801214:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801220:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801225:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801230:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801236:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801242:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801248:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801253:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801265:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801271:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801279:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801285:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801291:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801298:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801304:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801310:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801315:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801321:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801327:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801333:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801339:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801345:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801360:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801366:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801372:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801379:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801385:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801392:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801398:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801404:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801410:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801416:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801421:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801427:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801432:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801438:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801444:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801450:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801456:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604175.801461:0:20249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1787604175.805104:0:20249:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787604175.805114:0:20249:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1787604175.816971:0:20249:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0a0b76d68a0 - data ffffa09f8144f948/ffffa0a083f9e800 00000020:01000000:3.0:1787604175.817551:0:20249:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0a0bf0b1780 - data ffffa0a0a695ea20/ffffa0a0bfa1ec00 00000020:00000080:2.0:1787604175.825821:0:20249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dc8a0 00000020:00000080:2.0:1787604175.825833:0:20249:0:(genops.c:885:class_export_put()) final put ffffa0a087ce3000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787604175.825851:0:20249:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0a0b74ab800 from MGS, refs=2 00000020:01000004:2.0:1787604175.825854:0:20249:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0a0b74ab800 2 00000020:01000004:2.0:1787604175.825858:0:20249:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa0a0b74ab800 from MGS 00000020:00000080:2.0:1787604175.825915:0:20249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787604175.825928:0:20249:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787604175.825931:0:20249:0:(genops.c:885:class_export_put()) final put ffffa0a087ce1800/MGS 00000020:00000080:2.0:1787604175.825933:0:20249:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a087ce1800/MGS for MGS 00000020:01000000:2.0:1787604175.825952:0:20249:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1787604175.826017:0:20249:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787604175.826021:0:20249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787604175.826026:0:20249:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787604175.826033:0:20249:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffffa0a09808d000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787604175.826039:0:20249:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffffa0a0c115cd28) has exports, disconnecting them 00000020:00080000:2.0:1787604175.826044:0:20249:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffffa0a09808d000), last request at 1787604079 00000020:00000080:2.0:1787604175.826064:0:20249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dc9a3 00000020:00080000:2.0:1787604175.826078:0:20249:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0a09808d000): rc 0 00000020:00000080:2.0:1787604175.826087:0:20249:0:(genops.c:885:class_export_put()) final put ffffa0a09808d000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787604175.826936:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a087ce3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787604175.826952:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a09808d000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1787604175.828338:0:20249:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1787604175.828347:0:20249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787604175.828357:0:20249:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787604175.828366:0:20249:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787604175.828402:0:492:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa09f841eb000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787604175.828605:0:20249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787604175.828615:0:20249:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1787604175.828621:0:20249:0:(genops.c:885:class_export_put()) final put ffffa09f841e9000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787604175.828625:0:20249:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f841e9000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787604175.828634:0:20249:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1787604175.828873:0:20249:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0a0b74ab800 1 00000020:00000080:3.0:1787604175.828881:0:20249:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dc892 00000020:00000080:3.0:1787604175.829100:0:20249:0:(genops.c:885:class_export_put()) final put ffffa0a087ce2000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1787604175.830085:0:20249:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1787604175.830107:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a087ce2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787604175.830409:0:20249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787604175.830420:0:20249:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787604175.830424:0:20249:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffffa09f899c8000) has no exports 00000100:00080000:3.0:1787604175.865035:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787604175.865050:0:492:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787604175.865056:0:492:0:(import.c:65:import_set_state_nolock()) ffffa0a0888fc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787604175.865066:0:492:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 550 00000100:00080000:3.0:1787604175.865074:0:492:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787604175.865084:0:492:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffffa0a0888fc000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1787604175.865113:0:492:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a086312680 x1874438316590464/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787604175.865194:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787604175.865198:0:492:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787604175.865200:0:492:0:(import.c:65:import_set_state_nolock()) ffffa0a086de1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787604175.865204:0:492:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 550 00000100:00080000:3.0:1787604175.865207:0:492:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787604175.865211:0:492:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffffa0a086de1800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1787604175.865258:0:492:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a0a009d180 x1874438316590848/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787604175.865269:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787604175.865272:0:492:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787604175.865274:0:492:0:(import.c:65:import_set_state_nolock()) ffffa09f88317800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787604175.865277:0:492:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 550 00000100:00080000:3.0:1787604175.865280:0:492:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787604175.865293:0:492:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa09f88317800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1787604175.865307:0:492:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a0a009d880 x1874438316590976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787604175.865324:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787604175.865327:0:492:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787604175.865329:0:492:0:(import.c:65:import_set_state_nolock()) ffffa09f88830800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787604175.865332:0:492:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 550 00000100:00080000:3.0:1787604175.865335:0:492:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787604175.865338:0:492:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa09f88830800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1787604175.865552:0:492:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a0a009f480 x1874438316591232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787604175.865605:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a086312680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3449:1874438316590464:0@lo:38:kworker.0 00000100:00100000:3.0:1787604175.865720:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604175.865856:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a08ae69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316590720:0@lo:400:kworker.0 00000100:00100000:0.0:1787604175.866107:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604175.866199:0:3451:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787604175.866210:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bc4a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316590592:0@lo:400:kworker.0 00000100:00100000:0.0:1787604175.866248:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604175.866300:0:17037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316590464 00000100:00100000:0.0:1787604175.866309:0:17037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316590464 00000100:00100000:0.0:1787604175.866351:0:17037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787604175.866378:0:17037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a009c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3449:x1874438316590464:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787604175.866400:0:17037:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787604175.869962:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a086313100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3453:1874438316590336:0@lo:400:kworker.0 00000400:00000100:1.0:1787604175.870086:0:3453:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874438316590336 offset 0 length 224: 4 00000100:00100000:1.0:1787604175.870205:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3453:1874438316591360:0@lo:400:kworker.0 00000100:00100000:3.0:1787604175.870284:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3449:1874438316590848:0@lo:38:kworker.0 00000100:00100000:1.0:1787604175.871169:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604175.871243:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787604175.871253:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3453:1874438316591104:0@lo:400:kworker.0 00000100:00100000:1.0:1787604175.871297:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604175.871339:0:16397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316591360 00000100:00100000:1.0:1787604175.871349:0:16397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316591360 00000100:00100000:1.0:1787604175.871418:0:16397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316591104 00000100:00100000:1.0:1787604175.871422:0:16397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316591104 00000100:00100000:1.0:1787604175.871496:0:16397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787604175.871508:0:16397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3453:x1874438316591360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604175.871567:0:18010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787604175.871579:0:18010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3453:x1874438316591104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604175.871594:0:16397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3453:x1874438316591360:12345-0@lo:400:kworker.0 Request processed in 86us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604175.871602:0:16397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787604175.871626:0:18010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3453:x1874438316591104:12345-0@lo:400:kworker.0 Request processed in 49us (328us total) trans 0 rc 0/0 00000100:00080000:1.0:1787604175.871632:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787604175.871634:0:18010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:1.0:1787604175.871676:0:3453:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0a0a009e300 x1874438316591104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604175.871710:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3453:1874438316591104:0@lo:400:kworker.0 00010000:00080000:1.0:1787604175.871724:0:3453:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0a0a009ea00 x1874438316591360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604175.871733:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3453:1874438316591360:0@lo:400:kworker.0 00000100:00100000:1.0:1787604175.871768:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604175.871805:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3449:1874438316590976:0@lo:38:kworker.0 00000100:00100000:1.0:1787604175.871832:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604175.871850:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3449:1874438316591232:0@lo:38:kworker.0 00000100:00100000:3.0:1787604175.871884:0:16397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316590848 00000100:00100000:3.0:1787604175.871890:0:16397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316590848 00000100:00100000:1.0:1787604175.871897:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604175.871914:0:16397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316590976 00000100:00100000:3.0:1787604175.871918:0:16397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316590976 00000100:00100000:3.0:1787604175.871930:0:16397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316591232 00000100:00100000:3.0:1787604175.871933:0:16397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316591232 00000100:00100000:1.0:1787604175.871942:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787604175.871949:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3449:x1874438316590848:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787604175.871974:0:16396:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787604175.872012:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3449:x1874438316590848:12345-0@lo:38:kworker.0 Request processed in 61us (243us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787604175.873463:0:16397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787604175.873495:0:16397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3449:x1874438316590976:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787604175.873521:0:16397:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787604175.873602:0:16397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3449:x1874438316590976:12345-0@lo:38:kworker.0 Request processed in 108us (1768us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787604175.873610:0:16397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787604175.873628:0:16397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787604175.873633:0:16397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3449:x1874438316591232:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787604175.873643:0:16397:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787604175.873668:0:16397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3449:x1874438316591232:12345-0@lo:38:kworker.0 Request processed in 33us (1771us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787604175.873674:0:16397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787604175.873790:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1787604175.874207:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa0a086de1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787604175.874224:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787604175.874229:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3449:1874438316590848:0@lo:38:kworker.0 00000100:00080000:1.0:1787604175.874244:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f88317800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787604175.874247:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787604175.874250:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3449:1874438316590976:0@lo:38:kworker.0 00000100:00080000:1.0:1787604175.874258:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f88830800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787604175.874260:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787604175.874262:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3449:1874438316591232:0@lo:38:kworker.0 00000100:00100000:0.0:1787604175.881630:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316590720 00000100:00100000:0.0:1787604175.881644:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316590720 00000100:00100000:0.0:1787604175.881735:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316590592 00000100:00100000:0.0:1787604175.881740:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316590592 00000100:00100000:0.0:1787604175.881786:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787604175.881797:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c1730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316590720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604175.881893:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c1730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316590720:12345-0@lo:400:kworker.0 Request processed in 97us (15788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604175.881900:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787604175.881918:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787604175.881925:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c1732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316590592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604175.881953:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c1732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316590592:12345-0@lo:400:kworker.0 Request processed in 30us (15708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604175.881959:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1787604175.881990:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787604175.882045:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bc4a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316590592:0@lo:400:kworker.0 00000100:00100000:0.0:1787604175.882057:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a08ae69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316590720:0@lo:400:kworker.0 00000020:00000080:3.0:1787604175.890398:0:20249:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787604175.890524:0:20249:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1787604175.890532:0:20249:0:(genops.c:885:class_export_put()) final put ffffa0a0b74ac800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787604175.890537:0:20249:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0b74ac800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787604175.890545:0:20249:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1787604175.891205:0:20249:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa0a0b74ad800 00000020:02000400:3.0:1787604175.891317:0:20249:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1787604175.921879:0:17037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a009c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3449:x1874438316590464:12345-0@lo:38:kworker.0 Request processed in 55492us (56151us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787604175.921893:0:17037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1787604175.921944:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa0a0888fc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787604175.921949:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787604175.921953:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a086312680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3449:1874438316590464:0@lo:38:kworker.0 00010000:00010000:2.0:1787604176.694786:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604177.717994:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604177.910322:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7270a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316591488:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787604177.910419:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604177.910531:0:17712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316591488 00000100:00100000:1.0:1787604177.910541:0:17712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316591488 00000100:00100000:1.0:1787604177.910647:0:17712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787604177.910657:0:17712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c1733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316591488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787604177.910706:0:17712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787604177.910751:0:17712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c1733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316591488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604177.910759:0:17712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1787604177.910892:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787604177.910929:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7270a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316591488:0@lo:13:osp-pre-0-1.0 00000020:01000004:3.0:1787604178.278607:0:20407:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1787604178.297940:0:20407:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1787604178.297993:0:20407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e600/0x6c241a9cc41dca91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dca98 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604178.298062:0:20407:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e600/0x6c241a9cc41dca91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dca98 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604178.298072:0:20407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e600/0x6c241a9cc41dca91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dca98 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604178.298080:0:20407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e600/0x6c241a9cc41dca91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dca98 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604178.298094:0:20407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787604178.298099:0:20407:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787604178.298122:0:20407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787604178.298126:0:20407:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787604178.298132:0:20407:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787604178.298138:0:20407:0:(import.c:65:import_set_state_nolock()) ffffa0a086de1800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1787604178.298143:0:20407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787604178.298145:0:20407:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787604178.298148:0:20407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787604178.299630:0:20407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bfc00/0x6c241a9cc41dc9f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dc9f7 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604178.299679:0:18752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604178.299716:0:18752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e600/0x6c241a9cc41dca91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dca98 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604178.299865:0:20407:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bfc00/0x6c241a9cc41dc9f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dc9f7 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604178.300399:0:18752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc44e600 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:2.0:1787604178.300405:0:18752:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e600/0x6c241a9cc41dca91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dca98 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604178.300416:0:18752:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e600/0x6c241a9cc41dca91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c241a9cc41dca98 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787604178.300426:0:18752:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e600/0x6c241a9cc41dca91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c241a9cc41dca98 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604178.300427:0:20407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bfc00/0x6c241a9cc41dc9f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dc9f7 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604178.300437:0:18752:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787604178.300444:0:18752:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00010000:00010000:0.0:1787604178.300445:0:20407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bfc00/0x6c241a9cc41dc9f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dc9f7 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604178.300448:0:18752:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787604178.300493:0:18752:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e600/0x6c241a9cc41dca91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dca98 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604178.300500:0:18752:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787604178.300524:0:20407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604178.300533:0:20407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc41a800/0x6c241a9cc41dcc19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dcc20 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604178.300542:0:20407:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc41a800/0x6c241a9cc41dcc19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dcc20 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604178.300548:0:20407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc41a800/0x6c241a9cc41dcc19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dcc20 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604178.300555:0:20407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0a0bc41a800/0x6c241a9cc41dcc19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dcc20 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604178.300558:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3451:1874438316591616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787604178.300635:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787604178.301481:0:18752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e600/0x6c241a9cc41dca91 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dca98 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604178.301492:0:18752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e600/0x6c241a9cc41dca91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dca98 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604178.301527:0:18752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787604178.301532:0:18752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bfc00/0x6c241a9cc41dc9f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dc9f7 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604178.301538:0:18752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0b73bfc00 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:2.0:1787604178.301541:0:18752:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bfc00/0x6c241a9cc41dc9f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dc9f7 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604178.301549:0:18752:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bfc00/0x6c241a9cc41dc9f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c241a9cc41dc9f7 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787604178.301555:0:18752:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bfc00/0x6c241a9cc41dc9f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c241a9cc41dc9f7 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604178.301559:0:18752:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787604178.301561:0:18752:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1787604178.301582:0:18752:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bfc00/0x6c241a9cc41dc9f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dc9f7 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604178.301588:0:18752:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787604178.301607:0:18752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bfc00/0x6c241a9cc41dc9f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dc9f7 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604178.301613:0:18752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bfc00/0x6c241a9cc41dc9f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dc9f7 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604178.301621:0:18752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604178.301624:0:18752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0a0bc41a800/0x6c241a9cc41dcc19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dcc20 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604178.301640:0:18752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc41a800 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:2.0:1787604178.301643:0:18752:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0a0bc41a800/0x6c241a9cc41dcc19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dcc20 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604178.301649:0:18752:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0a0bc41a800/0x6c241a9cc41dcc19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c241a9cc41dcc20 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787604178.301655:0:18752:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0a0bc41a800/0x6c241a9cc41dcc19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c241a9cc41dcc20 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604178.301660:0:18752:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787604178.301663:0:18752:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1787604178.301676:0:18752:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0a0bc41a800/0x6c241a9cc41dcc19 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dcc20 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604178.301682:0:18752:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787604178.301707:0:18752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0a0bc41a800/0x6c241a9cc41dcc19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dcc20 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604178.301714:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604178.301715:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604178.301791:0:16381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316591616 00000100:00100000:3.0:1787604178.301799:0:16381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316591616 00000100:00100000:3.0:1787604178.301842:0:16381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787604178.301850:0:16381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a009f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3451:x1874438316591616:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787604178.301857:0:16381:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787604178 with bad export cookie 7792382515865307324 00010000:00010000:1.0:1787604178.303409:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604178.303436:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3452:1874438316591744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787604178.303501:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604178.303546:0:3452:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787604178.303552:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3452:1874438316591872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787604178.303572:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604178.303612:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316591744 00000100:00100000:1.0:1787604178.303618:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316591744 00000100:00100000:1.0:1787604178.303657:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316591872 00000100:00100000:1.0:1787604178.303660:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316591872 00000100:00100000:1.0:1787604178.303703:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787604178.303710:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7270a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3452:x1874438316591744:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787604178.303716:0:17055:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787604178 with bad export cookie 7792382515865307324 00000100:00100000:1.0:1787604178.303759:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7270a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3452:x1874438316591744:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (257us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787604178.303766:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787604178.303781:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787604178.303785:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7270380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3452:x1874438316591872:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787604178.303789:0:17055:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787604178 with bad export cookie 7792382515865307324 00000100:00100000:1.0:1787604178.303813:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7270380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3452:x1874438316591872:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (240us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787604178.303819:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1787604178.303848:0:3452:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.116@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787604178.303853:0:3452:0:(import.c:65:import_set_state_nolock()) ffffa09f8a7a6800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787604178.303856:0:3452:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1787604178.304465:0:20407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787604178.304474:0:20407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0a0bc41a800/0x6c241a9cc41dcc19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dcc20 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787604178.304494:0:20407:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787604178.304504:0:20407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f600/0x6c241a9cc41dce7a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dce81 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604178.304520:0:20407:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f600/0x6c241a9cc41dce7a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dce81 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604178.304527:0:20407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f600/0x6c241a9cc41dce7a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dce81 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604178.304535:0:20407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f600/0x6c241a9cc41dce7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dce81 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604178.304549:0:20407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604178.304555:0:20407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bfe00/0x6c241a9cc41dc9e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dc9e9 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604178.304562:0:20407:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bfe00/0x6c241a9cc41dc9e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dc9e9 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604178.304567:0:20407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bfe00/0x6c241a9cc41dc9e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dc9e9 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604178.304573:0:20407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bfe00/0x6c241a9cc41dc9e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dc9e9 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604178.304579:0:20407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787604178.304582:0:20407:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1787604178.304586:0:20407:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1787604178.304610:0:20407:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1787604178.304615:0:20407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1787604178.304620:0:20407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787604178.304626:0:20407:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1787604178.304642:0:20407:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffffa09f81099000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787604178.304648:0:20407:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffffa09f88314800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787604178.304653:0:20407:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffffa09f884a99b8) has exports, disconnecting them 00000020:00080000:0.0:1787604178.304657:0:20407:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffffa09f81099000), last request at 1787604175 00000020:00000080:0.0:1787604178.304664:0:20407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dcc0b 00000100:00080000:0.0:1787604178.304681:0:20407:0:(import.c:65:import_set_state_nolock()) ffffa09f8109e800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787604178.304740:0:20407:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa09f81099000): rc 0 00000020:00000080:0.0:1787604178.304743:0:20407:0:(genops.c:885:class_export_put()) final put ffffa09f81099000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1787604178.304753:0:20407:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffffa09f88314800), last request at 1787604175 00000020:00000080:0.0:1787604178.304756:0:20407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dcb71 00000100:00080000:0.0:1787604178.304761:0:20407:0:(import.c:65:import_set_state_nolock()) ffffa09f88310800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1787604178.304771:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f81099000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1787604178.304816:0:492:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa09f8109e800 for lustre-MDT0001 00000020:00080000:0.0:1787604178.304829:0:20407:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa09f88314800): rc 0 00000020:00000080:0.0:1787604178.304831:0:20407:0:(genops.c:885:class_export_put()) final put ffffa09f88314800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1787604178.304842:0:20407:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb18e00d7fae0 00000020:00000080:0.0:1787604178.304852:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f88314800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1787604178.304877:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa09f88310800 for lustre-MDT0001 00000100:00080000:0.0:1787604178.304898:0:20407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787604178.304901:0:20407:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:2.0:1787604178.305062:0:18752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787604178.305070:0:18752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f600/0x6c241a9cc41dce7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dce81 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604178.305079:0:18752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc44f600 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:2.0:1787604178.305083:0:18752:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f600/0x6c241a9cc41dce7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dce81 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604178.305103:0:18752:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f600/0x6c241a9cc41dce7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c241a9cc41dce81 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787604178.305110:0:18752:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f600/0x6c241a9cc41dce7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c241a9cc41dce81 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604178.305117:0:18752:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787604178.305119:0:18752:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787604178.305121:0:18752:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787604178.305141:0:16383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604178.305145:0:16383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bfe00/0x6c241a9cc41dc9e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dc9e9 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604178.305152:0:16383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0b73bfe00 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:2.0:1787604178.305155:0:16383:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bfe00/0x6c241a9cc41dc9e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dc9e9 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604178.305162:0:16383:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bfe00/0x6c241a9cc41dc9e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c241a9cc41dc9e9 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787604178.305179:0:16383:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bfe00/0x6c241a9cc41dc9e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c241a9cc41dc9e9 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604178.305184:0:16383:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787604178.305187:0:16383:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787604178.305189:0:16383:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:0.0:1787604178.305674:0:20407:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787604178.305679:0:20407:0:(import.c:65:import_set_state_nolock()) ffffa0a0888fc000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:0.0:1787604178.307234:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604178.310984:0:16381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a009f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3451:x1874438316591616:12345-0@lo:103:ldlm_bl.0 Request processed in 9128us (10343us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787604178.311011:0:16381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1787604178.311058:0:3451:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.116@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787604178.311209:0:20407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787604178.311214:0:20407:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1787604178.311231:0:20407:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787604178.311330:0:20407:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787604178.311354:0:20407:0:(import.c:65:import_set_state_nolock()) ffffa0a088a21000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787604178.311377:0:20407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787604178.311380:0:20407:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1787604178.311390:0:20407:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787604178.311461:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a086312680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3449:1874438316592000:0@lo:9:umount.0 00000100:00100000:0.0:1787604178.311505:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787604178.311542:0:20407:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787604178.311553:0:20407:0:(import.c:65:import_set_state_nolock()) ffffa0a0bcfe9000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787604178.311568:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bc4a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3449:1874438316592128:0@lo:9:umount.0 00000100:00100000:0.0:1787604178.311620:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604178.311650:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316592000 00000100:00100000:0.0:1787604178.311655:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316592000 00000100:00100000:0.0:1787604178.311707:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316592128 00000100:00100000:0.0:1787604178.311710:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316592128 00000100:00100000:0.0:1787604178.311743:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787604178.311751:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a08ae69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3449:x1874438316592000:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787604178.311776:0:18751:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dcb9b 00000100:00080000:0.0:1787604178.311785:0:18751:0:(import.c:65:import_set_state_nolock()) ffffa09f89c3c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787604178.311814:0:18751:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1787604178.317305:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a08ae69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3449:x1874438316592000:12345-0@lo:9:umount.0 Request processed in 5543us (5789us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604178.317321:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787604178.317361:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787604178.317378:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a084f13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3449:x1874438316592128:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787604178.317410:0:18751:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dcc35 00000100:00080000:0.0:1787604178.317422:0:18751:0:(import.c:65:import_set_state_nolock()) ffffa09f888bb000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787604178.317458:0:18751:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:0.0:1787604178.318661:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a084f13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3449:x1874438316592128:12345-0@lo:9:umount.0 Request processed in 1287us (7035us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604178.318704:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1787604178.318743:0:16391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787604178.318785:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa0a0bcfe9000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787604178.318792:0:3449:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787604178.318794:0:3449:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787604178.318798:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bc4a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3449:1874438316592128:0@lo:9:umount.0 00000100:00080000:0.0:1787604178.318811:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa0a088a21000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787604178.318815:0:3449:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787604178.318816:0:3449:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787604178.318818:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a086312680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3449:1874438316592000:0@lo:9:umount.0 00010000:00010000:0.0:1787604178.318846:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787604178.318879:0:20407:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffffa09f884a99b8) has no exports 00000100:00080000:1.0:1787604178.334228:0:3452:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.116@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787604178.334233:0:3452:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787604178.334243:0:3452:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0a086313100 x1874438316590336/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787604191 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604178.334259:0:3452:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa09f89d93480 x1874438316591616/t0(0) o103->MGC192.168.203.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787604194 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604178.334268:0:3452:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa09f89d90000 x1874438316591744/t0(0) o103->MGC192.168.203.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787604194 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604178.334277:0:3452:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa09f89d93100 x1874438316591872/t0(0) o103->MGC192.168.203.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787604194 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787604178.335531:0:3452:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787604178.335554:0:3452:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787604178.335556:0:3452:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787604178.336397:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a086313100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3453:1874438316590336:0@lo:400:kworker.0 00010000:00010000:2.0:1787604178.336458:0:18752:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f600/0x6c241a9cc41dce7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dce81 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604178.336481:0:18752:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787604178.336512:0:18752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f600/0x6c241a9cc41dce7a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dce81 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604178.336521:0:18752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f600/0x6c241a9cc41dce7a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dce81 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604178.336538:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604178.336540:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604178.336542:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604178.336553:0:16383:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bfe00/0x6c241a9cc41dc9e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dc9e9 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604178.336559:0:16383:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787604178.336565:0:16383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bfe00/0x6c241a9cc41dc9e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dc9e9 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604178.336571:0:16383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bfe00/0x6c241a9cc41dc9e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c241a9cc41dc9e9 expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604178.336585:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604178.336587:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604178.336589:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604178.336735:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:449a3e36-c3ea-43c4-8436-5c48a977c3d4:0:1874438316592256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787604178.336750:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787604178.336754:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:449a3e36-c3ea-43c4-8436-5c48a977c3d4:0:1874438316592384:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787604178.339536:0:3451:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffffa09f8a7a6800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1787604178.339569:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3451:1874438316591616:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787604178.342441:0:3452:0:(import.c:65:import_set_state_nolock()) ffffa09f8a7a6800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787604178.342451:0:3452:0:(import.c:510:import_select_connection()) MGC192.168.203.116@tcp: connect to NID 0@lo last attempt 459 00000100:00080000:1.0:1787604178.342460:0:3452:0:(import.c:624:import_select_connection()) MGC192.168.203.116@tcp: import ffffa09f8a7a6800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1787604178.342584:0:3452:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a0b7270700 x1874438316592512/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787604178.342643:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3449:1874438316592512:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1787604178.342716:0:3449:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874438316592512 offset 0 length 520: 4 00000100:00100000:1.0:1787604178.342852:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3452:1874438316591744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787604178.342875:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3452:1874438316591872:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1787604178.351075:0:20407:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffffa09f884a99b8) has no exports 00000020:01000000:3.0:1787604178.412832:0:20407:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa09f89398f60 - data ffffa0a0a66e3e58/ffffa09f8916c000 00000020:01000000:3.0:1787604178.413175:0:20407:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0a0bc47ad80 - data ffffa0a098b04438/ffffa09f81aa7400 00000001:00000004:3.0:1787604178.427183:0:20407:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:0.0:1787604178.520671:0:20407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787604178.520682:0:20407:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787604178.520725:0:20407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1787604178.523639:0:20407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787604178.523648:0:20407:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1787604178.523671:0:20407:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787604178.523674:0:20407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787604178.523957:0:17038:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787604178.523963:0:17038:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1787604178.523973:0:17038:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1787604178.530090:0:20407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787604178.530097:0:20407:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1787604178.530110:0:20407:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787604178.530113:0:20407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787604178.530499:0:17040:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787604178.530503:0:17040:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1787604178.530521:0:17040:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1787604178.590196:0:20407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dca05 00000020:00000080:3.0:1787604178.590210:0:20407:0:(genops.c:885:class_export_put()) final put ffffa0a0b6c52800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787604178.594709:0:20407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dca1a 00000020:00000080:3.0:1787604178.594724:0:20407:0:(genops.c:885:class_export_put()) final put ffffa0a0c14af800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787604178.594732:0:20407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1787604178.594741:0:20407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787604178.594751:0:20407:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787604178.594755:0:20407:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffffa09f884ab370) has no exports 00000004:01000000:3.0:1787604178.594922:0:20407:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787604178.594930:0:20407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dca6e 00000020:00000080:3.0:1787604178.594935:0:20407:0:(genops.c:885:class_export_put()) final put ffffa09f8895d800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787604178.594939:0:20407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1787604178.594943:0:20407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787604178.594947:0:20407:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787604178.594950:0:20407:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffffa09f884acd28) has no exports 00000020:00000080:3.0:1787604178.594956:0:20407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dca67 00000020:00000080:3.0:1787604178.594959:0:20407:0:(genops.c:885:class_export_put()) final put ffffa0a0bc131800/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1787604178.595436:0:20407:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787604178.595441:0:20407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787604178.595445:0:20407:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1787604178.595451:0:20407:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787604178.595454:0:20407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787604178.595500:0:20407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787604178.595506:0:20407:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787604178.595511:0:20407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dca59 00000020:00000080:3.0:1787604178.595516:0:20407:0:(genops.c:885:class_export_put()) final put ffffa0a0bc136800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787604178.595521:0:20407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1787604178.595525:0:20407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787604178.595527:0:20407:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787604178.595530:0:20407:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffffa09f899cb370) has no exports 00000020:00000080:3.0:1787604178.595533:0:20407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dca52 00000020:00000080:3.0:1787604178.595536:0:20407:0:(genops.c:885:class_export_put()) final put ffffa0a0b749d000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1787604178.595855:0:20407:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787604178.595860:0:20407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787604178.595862:0:20407:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1787604178.595865:0:20407:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787604178.595867:0:20407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787604178.595896:0:20407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787604178.595901:0:20407:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1787604178.595910:0:20407:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1787604178.595914:0:20407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dca3d 00000020:00000080:3.0:1787604178.595918:0:20407:0:(genops.c:885:class_export_put()) final put ffffa0a0b6c54800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787604178.595922:0:20407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1787604178.595925:0:20407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787604178.595928:0:20407:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787604178.595930:0:20407:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffffa0a0bcfe0000) has no exports 00000020:00000080:3.0:1787604178.595934:0:20407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dca36 00000020:00000080:3.0:1787604178.595937:0:20407:0:(genops.c:885:class_export_put()) final put ffffa0a0b6c57000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787604178.596156:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0b6c52800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1787604178.596182:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0c14af800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1787604178.596194:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f8895d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1787604178.596200:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0bc131800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1787604178.596206:0:492:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0a0bcfe9000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1787604178.596211:0:492:0:(genops.c:885:class_export_put()) final put ffffa0a0bc136000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787604178.596213:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0bc136000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1787604178.596218:0:492:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787604178.596287:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0bc136800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1787604178.596292:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0b749d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1787604178.596298:0:492:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0a088a21000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1787604178.596302:0:492:0:(genops.c:885:class_export_put()) final put ffffa0a0bcfef800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787604178.596304:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0bcfef800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1787604178.596307:0:492:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787604178.596330:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0b6c54800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1787604178.596334:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0b6c57000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1787604178.597636:0:20407:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1787604178.597642:0:20407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787604178.597645:0:20407:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787604178.597651:0:20407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787604178.597740:0:20407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787604178.597750:0:20407:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787604178.597786:0:20407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787604178.597789:0:20407:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787604178.597794:0:20407:0:(genops.c:885:class_export_put()) final put ffffa0a0bcebd800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787604178.597798:0:20407:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0bcebd800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1787604178.597804:0:20407:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787604178.597942:0:20407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dca21 00000020:00000080:3.0:1787604178.597949:0:20407:0:(genops.c:885:class_export_put()) final put ffffa0a0c14aa800/lustre-MDD0001_UUID 00000020:01000000:3.0:1787604178.597954:0:20407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1787604178.597958:0:20407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787604178.597963:0:20407:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787604178.597967:0:20407:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffffa09f884a8000) has no exports 00000020:00000080:0.0:1787604178.598096:0:492:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0a0888fc000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1787604178.598105:0:492:0:(genops.c:885:class_export_put()) final put ffffa0a0b749b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787604178.598107:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0b749b000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1787604178.598111:0:492:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787604178.598203:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0c14aa800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1787604178.598383:0:20407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787604178.598388:0:20407:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1787604178.598391:0:20407:0:(genops.c:885:class_export_put()) final put ffffa0a0b6c55800/lustre-MDD0001_UUID 00000020:00000080:3.0:1787604178.598393:0:20407:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0b6c55800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1787604178.598397:0:20407:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1787604178.598509:0:20407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dca28 00000020:00000080:3.0:1787604178.598514:0:20407:0:(genops.c:885:class_export_put()) final put ffffa0a0c14ad000/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1787604178.598564:0:20407:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0a0ae462000 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1787604178.598568:0:20407:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0a0ae462000 2 00000020:01000004:3.0:1787604178.598572:0:20407:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa0a0ae462000 from lustre-MDT0001 00000020:00000080:3.0:1787604178.598596:0:20407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787604178.598623:0:20407:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1787604178.598631:0:20407:0:(genops.c:885:class_export_put()) final put ffffa0a0b6c51000/lustre-MDT0001_UUID 00000020:00000080:3.0:1787604178.598633:0:20407:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0b6c51000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1787604178.598789:0:20407:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1787604178.598814:0:20407:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1787604178.598824:0:20407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1787604178.598827:0:20407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787604178.598831:0:20407:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787604178.598838:0:20407:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffffa09f889a3000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787604178.598853:0:20407:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffffa09f899ccd28) has exports, disconnecting them 00000020:00080000:3.0:1787604178.598857:0:20407:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffffa09f889a3000), last request at 1787604091 00000020:00000080:3.0:1787604178.598860:0:20407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dcaa6 00000020:00080000:3.0:1787604178.598867:0:20407:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa09f889a3000): rc 0 00000020:00000080:3.0:1787604178.598870:0:20407:0:(genops.c:885:class_export_put()) final put ffffa09f889a3000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1787604178.598907:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0c14ad000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1787604178.599594:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f889a3000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1787604178.600127:0:20407:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1787604178.600130:0:20407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787604178.600133:0:20407:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787604178.600138:0:20407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787604178.600200:0:492:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0a086de1800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787604178.600379:0:20407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787604178.600385:0:20407:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1787604178.600388:0:20407:0:(genops.c:885:class_export_put()) final put ffffa0a086de5000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1787604178.600390:0:20407:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a086de5000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1787604178.600394:0:20407:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1787604178.600428:0:20407:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0a0ae462000 1 00000020:00000080:3.0:1787604178.600433:0:20407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dc9cd 00000020:00000080:3.0:1787604178.600438:0:20407:0:(genops.c:885:class_export_put()) final put ffffa0a0bcfe8000/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1787604178.600449:0:20407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1787604178.600452:0:20407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787604178.600456:0:20407:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787604178.600459:0:20407:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffffa0a0b77d19b8) has no exports 00000020:00000080:0.0:1787604178.600661:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0bcfe8000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1787604178.630874:0:20407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787604178.631050:0:20407:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1787604178.631057:0:20407:0:(genops.c:885:class_export_put()) final put ffffa0a088a25800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787604178.631072:0:20407:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a088a25800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1787604178.631097:0:20407:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1787604178.631260:0:20407:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa0a088a20800 00000020:01000000:0.0:1787604178.631282:0:20407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1787604178.631286:0:20407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787604178.631291:0:20407:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787604178.631296:0:20407:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffffa0a0c11599b8) has no exports 00000100:00100000:0.0:1787604178.631372:0:16395:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffffa0a0888e7200:16395] 0 exiting: rc = 1 00000100:00100000:3.0:1787604178.631883:0:16397:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffffa0a088b80000:16397] 2 exiting: rc = 0 00000100:00100000:1.0:1787604178.634110:0:16396:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffffa0a088b80a00:16396] 1 exiting: rc = 0 00000100:00100000:1.0:1787604178.634231:0:18010:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffffa0a0854b7000:18010] 3 exiting: rc = 0 00000100:00100000:0.0:1787604178.634373:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634389:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634397:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634403:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634408:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634413:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634418:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634423:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634433:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634440:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634446:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634457:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634466:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634475:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634485:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634498:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634514:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634531:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634550:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634559:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634568:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634578:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634591:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634600:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634608:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634618:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634640:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634648:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634654:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634662:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634671:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634679:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634712:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634722:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634735:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634743:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634751:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634756:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634761:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634765:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634770:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634774:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634779:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634783:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634788:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634793:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634797:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634802:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634806:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634811:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634818:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634825:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634829:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634834:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634841:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634855:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634861:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634867:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634873:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634878:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634883:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634893:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634897:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.634903:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.644505:0:16399:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffffa0a088b81400:16399] 1 exiting: rc = 0 00000100:00100000:0.0:1787604178.645670:0:16398:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffffa0a088b80c00:16398] 0 exiting: rc = 1 00000100:00100000:1.0:1787604178.646378:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646388:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646398:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646435:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646441:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646448:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646457:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646464:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646470:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646477:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646483:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646488:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646505:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646511:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646519:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646543:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646571:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646579:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646585:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646591:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646597:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646602:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646608:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646620:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646625:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646632:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646638:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646645:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646653:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646681:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646707:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646714:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646723:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646734:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646739:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646750:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646755:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646759:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646763:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646768:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646772:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646776:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646781:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646785:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646789:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646793:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646808:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646868:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646874:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646878:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646884:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646889:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646894:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646899:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646903:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646908:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646913:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646919:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646925:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646930:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646936:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646941:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646971:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.646977:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.651366:0:16400:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffffa09f8899ac00:16400] 0 exiting: rc = 1 00000100:00100000:2.0:1787604178.652660:0:16401:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffffa09f8899aa00:16401] 1 exiting: rc = 0 00000100:00100000:1.0:1787604178.655049:0:17037:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffffa0a0c1150a00:17037] 2 exiting: rc = 0 00000100:00100000:0.0:1787604178.655156:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655174:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655181:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655187:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655193:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655200:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655206:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655212:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655222:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655228:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655234:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655240:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655267:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655276:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655282:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655300:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655308:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655314:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655320:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655327:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655334:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655340:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655346:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655352:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655385:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655393:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655399:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655520:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655530:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655536:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655553:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655560:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655566:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655572:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655577:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655583:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655604:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655611:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655617:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655623:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655629:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655635:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655641:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655647:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655653:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655660:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655666:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655672:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655711:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655718:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655723:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655728:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655734:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655741:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655746:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655751:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655758:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655764:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655771:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655777:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655799:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655806:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655812:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.655818:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604178.672606:0:16402:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffffa09f883eae00:16402] 0 exiting: rc = 1 00000100:00100000:0.0:1787604178.674456:0:16403:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffffa09f883ea000:16403] 1 exiting: rc = 0 00000100:00100000:1.0:1787604178.674669:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674677:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674682:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674715:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674721:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674727:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674732:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674737:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674743:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674748:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674753:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674758:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674763:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674768:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674773:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674779:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674783:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674799:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674804:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674809:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674814:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674819:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674824:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674829:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674834:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674839:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674843:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674848:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674853:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674859:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674864:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674870:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674876:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674881:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674885:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674890:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674896:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674901:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674907:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674912:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674917:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674922:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674927:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674932:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674937:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674943:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674948:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674953:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674958:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674964:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674969:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674985:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.674998:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.675003:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.675007:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.675011:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.675017:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.675022:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.675026:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.675031:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.675036:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.675041:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.675045:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.675050:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604178.675959:0:16404:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffffa09f883ea600:16404] 0 exiting: rc = 1 00000100:00100000:0.0:1787604178.676355:0:16405:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffffa09f883ebc00:16405] 1 exiting: rc = 0 00000100:00100000:1.0:1787604178.676482:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676489:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676494:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676499:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676504:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676509:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676513:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676519:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676525:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676530:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676534:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676539:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676544:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676549:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676553:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676558:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676562:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676567:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676571:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676575:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676580:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676585:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676589:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676602:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676606:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676611:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676616:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676621:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676626:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676631:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676636:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676640:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676644:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676649:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676654:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676659:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676663:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676670:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676675:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676679:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676706:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676711:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676716:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676721:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676726:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676731:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676736:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676741:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676746:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676751:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676755:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676760:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676765:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676770:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676774:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676779:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676783:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676788:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676798:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676803:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676809:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676814:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676819:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.676824:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604178.677620:0:16406:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffffa0a0832ae000:16406] 0 exiting: rc = 1 00000100:00100000:3.0:1787604178.677768:0:16407:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffffa09f883ea200:16407] 1 exiting: rc = 0 00000100:00100000:1.0:1787604178.678188:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678195:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678200:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678206:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678211:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678216:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678221:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678226:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678231:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678236:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678240:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678245:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678250:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678255:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678259:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678264:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678269:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678273:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678278:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678283:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678288:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678292:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678296:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678300:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678305:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678309:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678313:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678317:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678322:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678335:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678340:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678345:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678349:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678354:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678359:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678364:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678369:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678373:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678378:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678382:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678388:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678392:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678397:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678402:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678418:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678424:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678428:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678433:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678438:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678443:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678448:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678453:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678458:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678463:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678468:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678472:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678477:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678481:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678486:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678490:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678495:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678499:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678504:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.678509:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787604178.679064:0:16408:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffffa0a0812e7400:16408] 0 exiting: rc = 1 00000100:00100000:3.0:1787604178.679337:0:16409:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffffa0a08487d000:16409] 1 exiting: rc = 0 00000100:00100000:2.0:1787604178.680246:0:16410:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffffa0a08633b200:16410] 2 exiting: rc = 0 00000100:00100000:1.0:1787604178.680288:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680295:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680301:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680307:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680312:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680317:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680322:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680345:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680352:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680357:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680363:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680368:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680374:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680379:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680384:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680389:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680394:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680399:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680405:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680542:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680548:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680554:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680560:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680566:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680571:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680577:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680582:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680588:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680593:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680599:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680606:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680627:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680634:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680640:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680645:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680659:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680665:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680670:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680677:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.680682:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.681058:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.681065:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.681070:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.681082:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.681161:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.681178:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.681184:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.681189:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.681194:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.681199:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.681204:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.681209:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.681214:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.681219:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.681226:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.681250:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.681257:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.681263:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.681268:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.681274:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.681279:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.681285:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.681290:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604178.681295:0:20407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787604178.688924:0:20407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787604178.688939:0:20407:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1787604178.688946:0:20407:0:(genops.c:885:class_export_put()) final put ffffa09f8a7a1800/MDS_uuid 00000020:00000080:1.0:1787604178.688951:0:20407:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f8a7a1800/MDS_uuid for MDS 00000020:01000000:1.0:1787604178.688957:0:20407:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1787604178.689213:0:20407:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1787604178.743206:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604179.766047:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787604180.046189:0:9030:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787604180.046201:0:9030:0:(genops.c:885:class_export_put()) final put ffffa09f888b9000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787604180.046236:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f888b9000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787604180.046283:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa09f888bb000 for lustre-OST0001 00010000:00010000:0.0:1787604180.789827:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787604180.982120:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) 449a3e36-c3ea-43c4-8436-5c48a977c3d4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787604180.982129:0:492:0:(pinger.c:247:ptlrpc_pinger_process_import()) 449a3e36-c3ea-43c4-8436-5c48a977c3d4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787604180.982132:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787604180.982136:0:492:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787604180.982139:0:492:0:(import.c:65:import_set_state_nolock()) ffffa09f88317800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787604180.982147:0:492:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 556 00000100:00080000:0.0:1787604180.982162:0:492:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787604180.982169:0:492:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa09f88317800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1787604180.982204:0:492:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a084f10a80 x1874438316592640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787604180.982242:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787604180.982245:0:492:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787604180.982247:0:492:0:(import.c:65:import_set_state_nolock()) ffffa09f88830800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787604180.982250:0:492:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 556 00000100:00080000:0.0:1787604180.982253:0:492:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787604180.982255:0:492:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa09f88830800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1787604180.982266:0:492:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a084f12680 x1874438316592896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787604180.982297:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3449:1874438316592640:0@lo:38:kworker.0 00000400:00000100:0.0:1787604180.982348:0:3449:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874438316592640 offset 0 length 520: 4 00000100:00100000:0.0:1787604180.982391:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3449:1874438316592896:0@lo:38:kworker.0 00000400:00000100:0.0:1787604180.982424:0:3449:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874438316592896 offset 0 length 520: 4 00000100:00100000:0.0:1787604180.982459:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3452:1874438316592768:0@lo:400:kworker.0 00000400:00000100:0.0:1787604180.982478:0:3452:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874438316592768 offset 0 length 224: 4 00000100:00100000:0.0:1787604180.982492:0:3452:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787604180.982497:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3452:1874438316593024:0@lo:400:kworker.0 00000400:00000100:0.0:1787604180.982512:0:3452:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874438316593024 offset 0 length 224: 4 00000020:01000004:0.0:1787604181.531363:0:20560:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1787604181.544990:0:20560:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787604181.545040:0:20560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a083e4b200/0x6c241a9cc41dcb40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dcb47 expref: -99 pid: 17707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604181.545056:0:20560:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a083e4b200/0x6c241a9cc41dcb40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dcb47 expref: -99 pid: 17707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604181.545062:0:20560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a083e4b200/0x6c241a9cc41dcb40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dcb47 expref: -99 pid: 17707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604181.545069:0:20560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0a083e4b200/0x6c241a9cc41dcb40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dcb47 expref: -99 pid: 17707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604181.545096:0:20560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787604181.545102:0:20560:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787604181.545121:0:20560:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787604181.545133:0:20560:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0a084f10a80 x1874438316592640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787604200 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787604181.545162:0:16384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787604181.545164:0:20560:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1787604181.545169:0:16384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0a083e4b200/0x6c241a9cc41dcb40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dcb47 expref: -99 pid: 17707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787604181.545170:0:20560:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1787604181.545176:0:16384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a083e4b200 already unused, calling callback (ffffffffc1d46c20) 00000100:00080000:0.0:1787604181.545177:0:20560:0:(import.c:65:import_set_state_nolock()) ffffa09f88317800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 10000000:00010000:2.0:1787604181.545180:0:16384:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0a083e4b200/0x6c241a9cc41dcb40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dcb47 expref: -99 pid: 17707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604181.545189:0:16384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0a083e4b200/0x6c241a9cc41dcb40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c241a9cc41dcb47 expref: -99 pid: 17707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787604181.545195:0:20560:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:00010000:2.0:1787604181.545196:0:16384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0a083e4b200/0x6c241a9cc41dcb40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c241a9cc41dcb47 expref: -99 pid: 17707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604181.545200:0:20560:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0a084f10a80 x1874438316592640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787604200 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787604181.545210:0:16384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787604181.545212:0:16384:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787604181.545215:0:16384:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:0.0:1787604181.545216:0:20560:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787604181.545219:0:20560:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00010000:00010000:2.0:1787604181.545226:0:16384:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa09f8a7a6800 00010000:00010000:2.0:1787604181.545237:0:16384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0a083e4b200/0x6c241a9cc41dcb40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c241a9cc41dcb47 expref: -99 pid: 17707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604181.545243:0:16384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0a083e4b200/0x6c241a9cc41dcb40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c241a9cc41dcb47 expref: -99 pid: 17707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604181.545253:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604181.545255:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604181.545257:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604181.545484:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3449:1874438316592640:0@lo:38:kworker.0 00000100:00080000:0.0:1787604181.546478:0:20560:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787604181.546487:0:20560:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0a084f10e00 x1874438316592768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604196 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604181.546502:0:20560:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787604181.546506:0:20560:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787604181.546527:0:20560:0:(import.c:65:import_set_state_nolock()) ffffa09f88311000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787604181.546747:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3452:1874438316592768:0@lo:400:kworker.0 00000100:00100000:2.0:1787604181.547055:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3449:1874438316593152:0@lo:39:umount.0 00000400:00000100:2.0:1787604181.547102:0:3449:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874438316593152 offset 0 length 224: 4 00010000:00010000:2.0:1787604181.814172:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787604182.053571:0:8099:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787604182.053581:0:8099:0:(genops.c:885:class_export_put()) final put ffffa09f89c3a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787604182.053813:0:15520:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f89c3a000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787604182.053938:0:15520:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa09f89c3c800 for lustre-OST0000 00010000:00010000:0.0:1787604182.838621:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787604183.032624:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) 449a3e36-c3ea-43c4-8436-5c48a977c3d4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787604183.032635:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) 449a3e36-c3ea-43c4-8436-5c48a977c3d4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787604183.032638:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787604183.032642:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787604183.032779:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3450:1874438316593280:0@lo:400:kworker.0 00000400:00000100:0.0:1787604183.032840:0:3450:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874438316593280 offset 0 length 224: 4 00010000:00010000:2.0:1787604183.861950:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604184.886100:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604185.911318:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787604186.040277:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) 449a3e36-c3ea-43c4-8436-5c48a977c3d4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787604186.040292:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) 449a3e36-c3ea-43c4-8436-5c48a977c3d4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787604186.040295:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787604186.040299:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787604186.040615:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3451:1874438316593408:0@lo:400:kworker.0 00000400:00000100:1.0:1787604186.040713:0:3451:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874438316593408 offset 0 length 224: 4 00010000:00010000:2.0:1787604186.934048:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604187.959575:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604188.725830:0:3449:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787604178/real 1787604178] req@ffffa0a0b7270700 x1874438316592512/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787604188 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604188.725865:0:3449:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0a0b7270700 x1874438316592512/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787604188 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787604188.725887:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f8a7a6800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787604188.725985:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1787604188.725990:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3449:1874438316592512:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1787604188.726234:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) 449a3e36-c3ea-43c4-8436-5c48a977c3d4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787604188.726240:0:15520:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787604188.726243:0:15520:0:(import.c:65:import_set_state_nolock()) ffffa09f8a7a6800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787604188.726248:0:15520:0:(import.c:510:import_select_connection()) MGC192.168.203.116@tcp: connect to NID 0@lo last attempt 558 00000100:00080000:2.0:1787604188.726253:0:15520:0:(import.c:589:import_select_connection()) MGC192.168.203.116@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787604188.726260:0:15520:0:(import.c:624:import_select_connection()) MGC192.168.203.116@tcp: import ffffa09f8a7a6800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1787604188.726292:0:15520:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa09f89d91f80 x1874438316593536/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787604188.726423:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3449:1874438316593536:0@lo:250:kworker.0 00000400:00000100:1.0:1787604188.726468:0:3449:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874438316593536 offset 0 length 520: 4 00000100:00080000:2.0:1787604188.726521:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787604188.726525:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787604188.726609:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787604188.726774:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3453:1874438316593664:0@lo:400:kworker.0 00000400:00000100:3.0:1787604188.726802:0:3453:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874438316593664 offset 0 length 224: 4 00010000:00010000:0.0:1787604188.982375:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604190.008758:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604191.030069:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604191.798420:0:3449:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787604181/real 1787604181] req@ffffa0a084f10700 x1874438316593152/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787604191 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604191.798452:0:3449:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0a084f10700 x1874438316593152/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787604191 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787604191.798473:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f88311000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787604191.798493:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3449:1874438316593152:0@lo:39:umount.0 00000100:00080000:0.0:1787604191.798652:0:20560:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787604191.798659:0:20560:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787604191.798663:0:20560:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787604191.799566:0:20560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc41b600/0x6c241a9cc41dcb16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dcb1d expref: -99 pid: 17707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604191.799580:0:20560:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc41b600/0x6c241a9cc41dcb16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dcb1d expref: -99 pid: 17707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604191.799587:0:20560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc41b600/0x6c241a9cc41dcb16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dcb1d expref: -99 pid: 17707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604191.799604:0:20560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0a0bc41b600/0x6c241a9cc41dcb16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dcb1d expref: -99 pid: 17707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604191.799635:0:20560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604191.799643:0:20560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bee00/0x6c241a9cc41dce6c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dce73 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604191.799650:0:20560:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bee00/0x6c241a9cc41dce6c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dce73 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604191.799657:0:20560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bee00/0x6c241a9cc41dce6c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dce73 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604191.799663:0:20560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bee00/0x6c241a9cc41dce6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dce73 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604191.799713:0:20560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787604191.799718:0:20560:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1787604191.799742:0:20560:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787604191.799747:0:20560:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1787604191.799752:0:20560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787604191.799758:0:20560:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787604191.799763:0:20560:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffffa0a0bcfe19b8) has no exports 00000020:00080000:0.0:1787604191.799787:0:20560:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffffa0a0bcfe19b8) has no exports 00010000:00010000:3.0:1787604191.799871:0:16384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787604191.799880:0:16384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0a0bc41b600/0x6c241a9cc41dcb16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dcb1d expref: -99 pid: 17707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604191.799889:0:16384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc41b600 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:3.0:1787604191.799892:0:16384:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0a0bc41b600/0x6c241a9cc41dcb16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dcb1d expref: -99 pid: 17707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604191.799901:0:16384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0a0bc41b600/0x6c241a9cc41dcb16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c241a9cc41dcb1d expref: -99 pid: 17707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787604191.799909:0:16384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0a0bc41b600/0x6c241a9cc41dcb16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c241a9cc41dcb1d expref: -99 pid: 17707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787604191.799915:0:16384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787604191.799924:0:16384:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1787604191.799926:0:16384:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1787604191.799939:0:16384:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa09f8a7a6800 00010000:00010000:3.0:1787604191.799943:0:16384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0a0bc41b600/0x6c241a9cc41dcb16 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c241a9cc41dcb1d expref: -99 pid: 17707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604191.799950:0:16384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0a0bc41b600/0x6c241a9cc41dcb16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c241a9cc41dcb1d expref: -99 pid: 17707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604191.799962:0:16384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787604191.799966:0:16384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bee00/0x6c241a9cc41dce6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dce73 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604191.799971:0:16384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0b73bee00 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:3.0:1787604191.799975:0:16384:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bee00/0x6c241a9cc41dce6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dce73 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604191.799981:0:16384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bee00/0x6c241a9cc41dce6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c241a9cc41dce73 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787604191.799986:0:16384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bee00/0x6c241a9cc41dce6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c241a9cc41dce73 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787604191.799991:0:16384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787604191.799993:0:16384:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787604191.799995:0:16384:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787604191.800000:0:16384:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa09f8a7a6800 00010000:00010000:3.0:1787604191.800003:0:16384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bee00/0x6c241a9cc41dce6c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c241a9cc41dce73 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604191.800009:0:16384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bee00/0x6c241a9cc41dce6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c241a9cc41dce73 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604191.800026:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604191.800027:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604191.800029:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604191.800272:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787604191.801451:0:20560:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa09f88d4f9c0 - data ffffa0a0a6bd9000/ffffa09f812a1000 00000020:01000000:0.0:1787604191.801565:0:20560:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa09f894b5360 - data ffffa0a0a69eb870/ffffa09f81b33800 00100000:10000000:0.0:1787604191.823758:0:20560:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787604191.851666:0:20560:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dcb2b 00000020:00000080:0.0:1787604191.854354:0:20560:0:(genops.c:885:class_export_put()) final put ffffa0a0bcebb000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787604191.854388:0:20560:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa09f884b7800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787604191.854393:0:20560:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa09f884b7800 2 00000020:01000004:0.0:1787604191.854396:0:20560:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa09f884b7800 from lustre-OST0000 00000020:00000080:0.0:1787604191.854433:0:20560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787604191.854444:0:20560:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787604191.854448:0:20560:0:(genops.c:885:class_export_put()) final put ffffa09f88958800/lustre-OST0000_UUID 00000020:00000080:0.0:1787604191.854452:0:20560:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f88958800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787604191.854461:0:20560:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787604191.854521:0:20560:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787604191.854526:0:20560:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787604191.854531:0:20560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787604191.854536:0:20560:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787604191.854544:0:20560:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffffa09f88317000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787604191.854551:0:20560:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffffa0a0906a0000) has exports, disconnecting them 00000020:00080000:0.0:1787604191.854557:0:20560:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffffa09f88317000), last request at 1787604104 00000020:00000080:0.0:1787604191.854561:0:20560:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dcb55 00000020:00080000:0.0:1787604191.854576:0:20560:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa09f88317000): rc 0 00000020:00000080:0.0:1787604191.854581:0:20560:0:(genops.c:885:class_export_put()) final put ffffa09f88317000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787604191.855089:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a0bcebb000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787604191.855105:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f88317000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787604191.861795:0:20560:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787604191.861804:0:20560:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787604191.861809:0:20560:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787604191.861816:0:20560:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787604191.862015:0:20560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787604191.862025:0:20560:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1787604191.862031:0:20560:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787604191.862036:0:20560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787604191.862052:0:20560:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787604191.862060:0:20560:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffffa09f88312000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787604191.862068:0:20560:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffffa0a0906a19b8) has exports, disconnecting them 00000020:00080000:2.0:1787604191.862083:0:20560:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffffa09f88312000), last request at 1787604104 00000020:00000080:2.0:1787604191.862088:0:20560:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dcb6a 00000020:00080000:2.0:1787604191.862106:0:20560:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa09f88312000): rc 0 00000020:00000080:2.0:1787604191.862111:0:20560:0:(genops.c:885:class_export_put()) final put ffffa09f88312000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787604191.862866:0:492:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa09f88317800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787604191.862876:0:492:0:(genops.c:885:class_export_put()) final put ffffa09f88381000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787604191.862879:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f88381000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787604191.862891:0:492:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1787604191.862944:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f88312000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1787604191.868839:0:20560:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787604191.868848:0:20560:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787604191.868852:0:20560:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787604191.868859:0:20560:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787604191.868892:0:492:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa09f88311000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787604191.869061:0:20560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787604191.869071:0:20560:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1787604191.869088:0:20560:0:(genops.c:885:class_export_put()) final put ffffa09f88314000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1787604191.869092:0:20560:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f88314000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1787604191.869098:0:20560:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1787604191.869151:0:20560:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa09f884b7800 1 00000020:00000080:3.0:1787604191.869157:0:20560:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dcb08 00000020:00000080:3.0:1787604191.869164:0:20560:0:(genops.c:885:class_export_put()) final put ffffa09f88383000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1787604191.869172:0:20560:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1787604191.869179:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f88383000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787604191.869188:0:20560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787604191.869193:0:20560:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787604191.869197:0:20560:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffffa0a0b77d0000) has no exports 00000020:00000080:3.0:1787604191.886714:0:20560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787604191.886737:0:20560:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1787604191.886742:0:20560:0:(genops.c:885:class_export_put()) final put ffffa09f884b0800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1787604191.886747:0:20560:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f884b0800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1787604191.886756:0:20560:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1787604191.886869:0:20560:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa09f884b1000 00000020:02000400:3.0:1787604191.886920:0:20560:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1787604192.059156:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604193.078177:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787604193.789162:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) 449a3e36-c3ea-43c4-8436-5c48a977c3d4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787604193.789175:0:492:0:(pinger.c:247:ptlrpc_pinger_process_import()) 449a3e36-c3ea-43c4-8436-5c48a977c3d4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787604193.789178:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787604193.789181:0:492:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787604193.789270:0:3452:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787604193.789295:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3452:1874438316593792:0@lo:400:kworker.0 00000400:00000100:1.0:1787604193.789366:0:3452:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874438316593792 offset 0 length 224: 4 00010000:00010000:2.0:1787604194.101978:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787604194.379554:0:20714:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1787604194.396150:0:20714:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787604194.396230:0:20714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bf400/0x6c241a9cc41dcbda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dcbe1 expref: -99 pid: 18431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604194.396244:0:20714:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bf400/0x6c241a9cc41dcbda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dcbe1 expref: -99 pid: 18431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604194.396252:0:20714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bf400/0x6c241a9cc41dcbda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dcbe1 expref: -99 pid: 18431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604194.396260:0:20714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bf400/0x6c241a9cc41dcbda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dcbe1 expref: -99 pid: 18431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604194.396302:0:20714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787604194.396307:0:20714:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787604194.396327:0:20714:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787604194.396337:0:20714:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0a084f12680 x1874438316592896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787604200 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604194.396408:0:20714:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787604194.396415:0:20714:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787604194.396422:0:20714:0:(import.c:65:import_set_state_nolock()) ffffa09f88830800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787604194.396426:0:20714:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787604194.396430:0:20714:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0a084f12680 x1874438316592896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787604200 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787604194.396466:0:18752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604194.396473:0:18752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bf400/0x6c241a9cc41dcbda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dcbe1 expref: -99 pid: 18431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604194.396480:0:18752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0b73bf400 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:2.0:1787604194.396484:0:18752:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bf400/0x6c241a9cc41dcbda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dcbe1 expref: -99 pid: 18431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604194.396491:0:18752:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bf400/0x6c241a9cc41dcbda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c241a9cc41dcbe1 expref: -99 pid: 18431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787604194.396498:0:18752:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bf400/0x6c241a9cc41dcbda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c241a9cc41dcbe1 expref: -99 pid: 18431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604194.396503:0:18752:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787604194.396506:0:18752:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787604194.396508:0:18752:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787604194.396520:0:18752:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa09f8a7a6800 00010000:00010000:2.0:1787604194.396524:0:18752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bf400/0x6c241a9cc41dcbda lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c241a9cc41dcbe1 expref: -99 pid: 18431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604194.396542:0:18752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bf400/0x6c241a9cc41dcbda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c241a9cc41dcbe1 expref: -99 pid: 18431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604194.396552:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604194.396553:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604194.396555:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604194.397170:0:20714:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787604194.397345:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3449:1874438316592896:0@lo:38:kworker.0 00000100:00100000:0.0:1787604194.397393:0:20714:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1787604194.398528:0:20714:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787604194.398541:0:20714:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0a084f12d80 x1874438316593024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604196 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604194.398612:0:20714:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0a0a009ca80 x1874438316593280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604199 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604194.398633:0:20714:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0a0a009ce00 x1874438316593408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604202 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604194.398649:0:20714:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa09f89d92680 x1874438316593664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604204 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604194.398661:0:20714:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0a0b7270700 x1874438316593792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604209 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604194.398668:0:20714:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787604194.398673:0:20714:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787604194.398771:0:20714:0:(import.c:65:import_set_state_nolock()) ffffa09f88715000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787604194.398914:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3450:1874438316593280:0@lo:400:kworker.0 00000100:00100000:2.0:1787604194.398946:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3453:1874438316593664:0@lo:400:kworker.0 00000100:00100000:3.0:1787604194.399194:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3451:1874438316593408:0@lo:400:kworker.0 00000100:00100000:1.0:1787604194.399342:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3452:1874438316593024:0@lo:400:kworker.0 00000100:00100000:1.0:1787604194.399356:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3452:1874438316593792:0@lo:400:kworker.0 00000100:00100000:1.0:1787604194.399375:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3449:1874438316593920:0@lo:39:umount.0 00000400:00000100:1.0:1787604194.399419:0:3449:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874438316593920 offset 0 length 224: 4 00010000:00010000:1.0:1787604195.126318:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604196.152384:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604197.174427:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604198.197907:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787604198.901813:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) 449a3e36-c3ea-43c4-8436-5c48a977c3d4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787604198.901822:0:492:0:(pinger.c:247:ptlrpc_pinger_process_import()) 449a3e36-c3ea-43c4-8436-5c48a977c3d4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787604199.223417:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604200.246123:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604201.274236:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604202.295213:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604203.317968:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604203.637899:0:3449:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787604188/real 1787604188] req@ffffa09f89d91f80 x1874438316593536/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787604203 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604203.637930:0:3449:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa09f89d91f80 x1874438316593536/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787604203 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787604203.637973:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f8a7a6800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787604203.638045:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1787604203.638051:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3449:1874438316593536:0@lo:250:kworker.0 00000100:00080000:2.0:1787604203.638146:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) 449a3e36-c3ea-43c4-8436-5c48a977c3d4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787604203.638151:0:15520:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787604203.638154:0:15520:0:(import.c:65:import_set_state_nolock()) ffffa09f8a7a6800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787604203.638159:0:15520:0:(import.c:510:import_select_connection()) MGC192.168.203.116@tcp: connect to NID 0@lo last attempt 568 00000100:00080000:2.0:1787604203.638163:0:15520:0:(import.c:589:import_select_connection()) MGC192.168.203.116@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787604203.638170:0:15520:0:(import.c:624:import_select_connection()) MGC192.168.203.116@tcp: import ffffa09f8a7a6800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1787604203.638196:0:15520:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa09f89d92680 x1874438316594048/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787604203.638245:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3449:1874438316594048:0@lo:250:kworker.0 00000400:00000100:1.0:1787604203.638290:0:3449:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874438316594048 offset 0 length 520: 4 00010000:00010000:1.0:1787604204.343070:0:16384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604204.662417:0:3449:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787604194/real 1787604194] req@ffffa0a084f11c00 x1874438316593920/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787604204 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604204.662447:0:3449:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0a084f11c00 x1874438316593920/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787604204 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787604204.662466:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f88715000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787604204.662486:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3449:1874438316593920:0@lo:39:umount.0 00000100:00080000:0.0:1787604204.662724:0:20714:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787604204.662728:0:20714:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787604204.662733:0:20714:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787604204.663835:0:20714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bf200/0x6c241a9cc41dcbb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dcbb7 expref: -99 pid: 18431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604204.663849:0:20714:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bf200/0x6c241a9cc41dcbb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dcbb7 expref: -99 pid: 18431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604204.663856:0:20714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bf200/0x6c241a9cc41dcbb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dcbb7 expref: -99 pid: 18431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604204.663864:0:20714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bf200/0x6c241a9cc41dcbb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dcbb7 expref: -99 pid: 18431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604204.663955:0:20714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604204.663964:0:20714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44fc00/0x6c241a9cc41dce5e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dce65 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604204.663971:0:20714:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44fc00/0x6c241a9cc41dce5e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dce65 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604204.663977:0:20714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44fc00/0x6c241a9cc41dce5e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dce65 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604204.663995:0:20714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44fc00/0x6c241a9cc41dce5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c241a9cc41dce65 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604204.667663:0:20714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787604204.667707:0:20714:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787604204.667741:0:20714:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787604204.667746:0:20714:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787604204.667752:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787604204.667758:0:20714:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787604204.667763:0:20714:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffffa0a0bcfe4d28) has no exports 00000020:00080000:0.0:1787604204.667792:0:20714:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffffa0a0bcfe4d28) has no exports 00010000:00010000:1.0:1787604204.668396:0:18752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787604204.668407:0:18752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bf200/0x6c241a9cc41dcbb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dcbb7 expref: -99 pid: 18431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604204.668418:0:18752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0b73bf200 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:1.0:1787604204.668422:0:18752:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bf200/0x6c241a9cc41dcbb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dcbb7 expref: -99 pid: 18431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604204.668432:0:18752:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bf200/0x6c241a9cc41dcbb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c241a9cc41dcbb7 expref: -99 pid: 18431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787604204.668438:0:18752:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bf200/0x6c241a9cc41dcbb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c241a9cc41dcbb7 expref: -99 pid: 18431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787604204.668456:0:18752:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787604204.668459:0:18752:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1787604204.668462:0:18752:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1787604204.668477:0:18752:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa09f8a7a6800 00010000:00010000:1.0:1787604204.668482:0:18752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bf200/0x6c241a9cc41dcbb0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c241a9cc41dcbb7 expref: -99 pid: 18431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604204.668490:0:18752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bf200/0x6c241a9cc41dcbb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c241a9cc41dcbb7 expref: -99 pid: 18431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604204.668506:0:18752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787604204.668510:0:18752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44fc00/0x6c241a9cc41dce5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dce65 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604204.668515:0:18752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc44fc00 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:1.0:1787604204.668517:0:18752:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44fc00/0x6c241a9cc41dce5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c241a9cc41dce65 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604204.668523:0:18752:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44fc00/0x6c241a9cc41dce5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c241a9cc41dce65 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787604204.668529:0:18752:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44fc00/0x6c241a9cc41dce5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c241a9cc41dce65 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787604204.668533:0:18752:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787604204.668535:0:18752:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787604204.668537:0:18752:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787604204.668541:0:18752:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa09f8a7a6800 00010000:00010000:1.0:1787604204.668543:0:18752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44fc00/0x6c241a9cc41dce5e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c241a9cc41dce65 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604204.668554:0:18752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44fc00/0x6c241a9cc41dce5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c241a9cc41dce65 expref: -99 pid: 16392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604204.668567:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604204.668569:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604204.668571:0:18752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604204.668837:0:16383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787604204.673242:0:20714:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0a0b76d62a0 - data ffffa0a098a77438/ffffa0a083f9c000 00000020:01000000:0.0:1787604204.673630:0:20714:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0a085abda80 - data ffffa0a0a69fbaf8/ffffa09f8a465000 00100000:10000000:1.0:1787604204.705118:0:20714:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787604204.748452:0:20714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dcbc5 00000020:00000080:0.0:1787604204.748464:0:20714:0:(genops.c:885:class_export_put()) final put ffffa0a08351e000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787604204.748487:0:20714:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa09f81b82800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787604204.748490:0:20714:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa09f81b82800 2 00000020:01000004:0.0:1787604204.748494:0:20714:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa09f81b82800 from lustre-OST0001 00000020:00000080:0.0:1787604204.748519:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787604204.748529:0:20714:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787604204.748531:0:20714:0:(genops.c:885:class_export_put()) final put ffffa09f8109d800/lustre-OST0001_UUID 00000020:00000080:0.0:1787604204.748535:0:20714:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f8109d800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787604204.748543:0:20714:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1787604204.748636:0:20714:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 449a3e36-c3ea-43c4-8436-5c48a977c3d4->MGS 00010000:00010000:0.0:1787604204.748652:0:20714:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0a0bc41ae00/0x6c241a9cc41dc9d4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c241a9cc41dc9db expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787604204.748662:0:20714:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0a0bc41ae00/0x6c241a9cc41dc9d4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c241a9cc41dc9db expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787604204.748668:0:20714:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787604204.748670:0:20714:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787604204.748673:0:20714:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787604204.748782:0:20714:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa09f8a7a6800 00010000:00010000:0.0:1787604204.748786:0:20714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0a0bc41ae00/0x6c241a9cc41dc9d4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c241a9cc41dc9db expref: -99 pid: 17031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787604204.748913:0:15520:0:(genops.c:844:class_export_destroy()) destroying export ffffa0a08351e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00010000:00010000:3.0:1787604204.751713:0:20714:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bfa00/0x6c241a9cc41dc8c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c241a9cc41dc8ca expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787604204.751729:0:20714:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bfa00/0x6c241a9cc41dc8c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c241a9cc41dc8ca expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787604204.751735:0:20714:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787604204.751738:0:20714:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787604204.751740:0:20714:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787604204.751772:0:20714:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa09f8a7a6800 00010000:00010000:3.0:1787604204.751776:0:20714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0a0b73bfa00/0x6c241a9cc41dc8c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c241a9cc41dc8ca expref: -99 pid: 16377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787604204.751801:0:20714:0:(import.c:65:import_set_state_nolock()) ffffa09f8a7a6800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787604204.751805:0:20714:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787604204.751819:0:20714:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787604204.751820:0:20714:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787604204.751825:0:20714:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787604204.751835:0:20714:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa09f89d92680 x1874438316594048/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787604223 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787604204.751853:0:20714:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787604204.751855:0:20714:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:0.0:1787604204.752050:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:449a3e36-c3ea-43c4-8436-5c48a977c3d4:3449:1874438316594048:0@lo:250:kworker.0 10000000:01000000:3.0:1787604204.752285:0:20714:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787604204.752294:0:20714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dc8ae 00000020:00000080:3.0:1787604204.752315:0:20714:0:(genops.c:885:class_export_put()) final put ffffa09f8a7a7800/449a3e36-c3ea-43c4-8436-5c48a977c3d4 00000020:01000000:3.0:1787604204.752334:0:20714:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.116@tcp (flags='') 00000020:00000080:3.0:1787604204.752340:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787604204.752348:0:20714:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.116@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787604204.752352:0:20714:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffffa0a0c1158000) has no exports 00000020:00000080:2.0:1787604204.752402:0:15520:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f8a7a7800/449a3e36-c3ea-43c4-8436-5c48a977c3d4 for MGC192.168.203.116@tcp 10000000:01000000:0.0:1787604204.752449:0:16392:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1787604204.752800:0:20714:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.116@tcp: client import never connected 00000100:00080000:3.0:1787604204.752804:0:20714:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787604204.752806:0:20714:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787604204.752816:0:20714:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787604204.752818:0:20714:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787604204.752859:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787604204.752865:0:20714:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.116@tcp (uuid 449a3e36-c3ea-43c4-8436-5c48a977c3d4) 00000020:01000000:3.0:1787604204.752871:0:20714:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787604204.752874:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787604204.752879:0:20714:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787604204.752884:0:20714:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffffa09f88833800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787604204.752889:0:20714:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffffa0a0bcfe3370) has exports, disconnecting them 00000020:00080000:3.0:1787604204.752894:0:20714:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffffa09f88833800), last request at 1787604118 00000020:00000080:3.0:1787604204.752898:0:20714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dcbef 00000020:00000080:2.0:1787604204.752997:0:15520:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa09f8a7a6800 for MGC192.168.203.116@tcp 00000020:00000080:2.0:1787604204.753011:0:15520:0:(genops.c:885:class_export_put()) final put ffffa09f8a7a5000/449a3e36-c3ea-43c4-8436-5c48a977c3d4 00000020:00000080:2.0:1787604204.753013:0:15520:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f8a7a5000/449a3e36-c3ea-43c4-8436-5c48a977c3d4 for MGC192.168.203.116@tcp 00000020:01000000:2.0:1787604204.753020:0:15520:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.116@tcp (449a3e36-c3ea-43c4-8436-5c48a977c3d4) 00000020:00080000:3.0:1787604204.753404:0:20714:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa09f88833800): rc 0 00000020:00000080:3.0:1787604204.753411:0:20714:0:(genops.c:885:class_export_put()) final put ffffa09f88833800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787604204.754664:0:15520:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f88833800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1787604204.775653:0:20714:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787604204.775661:0:20714:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787604204.775665:0:20714:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787604204.775673:0:20714:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787604204.776004:0:15520:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa09f88830800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787604204.776156:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787604204.776166:0:20714:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787604204.776172:0:20714:0:(genops.c:885:class_export_put()) final put ffffa09f88836000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787604204.776176:0:20714:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f88836000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787604204.776189:0:20714:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1787604204.776252:0:20714:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787604204.776255:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787604204.776263:0:20714:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787604204.776270:0:20714:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffffa09f88711800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787604204.776276:0:20714:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffffa0a086233370) has exports, disconnecting them 00000020:00080000:3.0:1787604204.776281:0:20714:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffffa09f88711800), last request at 1787604118 00000020:00000080:3.0:1787604204.776286:0:20714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dcc04 00000020:00080000:3.0:1787604204.776300:0:20714:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa09f88711800): rc 0 00000020:00000080:3.0:1787604204.776304:0:20714:0:(genops.c:885:class_export_put()) final put ffffa09f88711800/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1787604204.777371:0:15520:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f88711800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1787604204.777737:0:20714:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787604204.777743:0:20714:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787604204.777746:0:20714:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787604204.777751:0:20714:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787604204.777833:0:15520:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa09f88715000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1787604204.778739:0:16384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1787604204.778993:0:16383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1787604204.779115:0:18752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1787604204.779323:0:16378:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffffa0a088bf2a00:16378] 0 exiting: rc = 1 00000100:00100000:3.0:1787604204.779563:0:16379:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffffa09f8824b400:16379] 1 exiting: rc = 0 00000100:00100000:2.0:1787604204.779756:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604204.780384:0:16380:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffffa09f893a6800:16380] 0 exiting: rc = 1 00000100:00100000:2.0:1787604204.780585:0:16382:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffffa09f893a6400:16382] 2 exiting: rc = 0 00000100:00100000:2.0:1787604204.780638:0:16381:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffffa09f893a7400:16381] 1 exiting: rc = 0 00000100:00100000:0.0:1787604204.780758:0:17055:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffffa0a082b8ea00:17055] 3 exiting: rc = 0 00000100:00100000:2.0:1787604204.780860:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.780867:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.780874:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.780880:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.780886:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.780893:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.780898:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.780993:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781000:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781006:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781012:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781017:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781023:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781030:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781035:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781040:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781045:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781051:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781069:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781074:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781159:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781168:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781173:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781179:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781184:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781190:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781195:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781201:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781206:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781212:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781217:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781222:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781227:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781233:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781239:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781243:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781249:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781254:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781259:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781265:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781269:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781275:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781280:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781285:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781291:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781297:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781302:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781307:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781312:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781317:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781323:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781329:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781335:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781348:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781353:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781358:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781363:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781368:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781374:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781378:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781384:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781390:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781395:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.781401:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787604204.782577:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787604204.782587:0:20714:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1787604204.782594:0:20714:0:(genops.c:885:class_export_put()) final put ffffa09f88712000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1787604204.782598:0:20714:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f88712000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1787604204.782604:0:20714:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1787604204.782640:0:20714:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa09f81b82800 1 00000020:00000080:2.0:1787604204.782645:0:20714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6c241a9cc41dcba9 00000020:00000080:2.0:1787604204.782651:0:20714:0:(genops.c:885:class_export_put()) final put ffffa09f88710800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1787604204.782719:0:20714:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1787604204.782723:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787604204.782728:0:20714:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787604204.782733:0:20714:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffffa09f813719b8) has no exports 00000020:00000080:0.0:1787604204.783411:0:15520:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f88710800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787604204.794823:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787604204.794838:0:20714:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787604204.794844:0:20714:0:(genops.c:885:class_export_put()) final put ffffa09f81b83800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787604204.794848:0:20714:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f81b83800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787604204.794858:0:20714:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787604204.795063:0:20714:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa09f81b80000 00000020:01000000:2.0:1787604204.795085:0:20714:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787604204.795089:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787604204.795094:0:20714:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787604204.795099:0:20714:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffffa09f81370000) has no exports 00000020:00000080:2.0:1787604204.795136:0:20714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787604204.795143:0:20714:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787604204.795146:0:20714:0:(genops.c:885:class_export_put()) final put ffffa09f88384800/OSS_uuid 00000020:00000080:2.0:1787604204.795148:0:20714:0:(genops.c:844:class_export_destroy()) destroying export ffffa09f88384800/OSS_uuid for OSS 00000020:01000000:2.0:1787604204.795152:0:20714:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1787604204.797913:0:16391:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787604204.798081:0:18751:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffffa09f890d5a00:18751] 4 exiting: rc = 0 00000100:00100000:0.0:1787604204.798144:0:17710:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffffa0a091e5fc00:17710] 1 exiting: rc = 0 00000100:00100000:0.0:1787604204.798199:0:18305:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffffa09f8a64fa00:18305] 3 exiting: rc = 0 00000100:00100000:0.0:1787604204.798247:0:17711:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffffa0a0bf0eae00:17711] 2 exiting: rc = 0 00000100:00100000:0.0:1787604204.798295:0:17708:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffffa0a08629da00:17708] 0 exiting: rc = 1 00000100:00100000:2.0:1787604204.799103:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799113:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799118:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799126:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799131:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799137:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799143:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799148:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799153:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799158:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799164:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799173:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799179:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799185:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799190:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799195:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799200:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799207:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799212:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799218:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799223:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799228:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799233:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799241:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799246:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799252:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799258:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799263:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799269:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799274:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799294:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799299:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799303:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799308:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799313:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799318:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799323:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799329:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799333:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799338:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799343:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799348:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799353:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799358:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799370:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799376:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799381:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799386:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799391:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799395:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799400:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799404:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799409:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799414:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799419:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799423:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799428:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799432:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799437:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799441:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799446:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799451:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799455:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.799460:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787604204.800546:0:17712:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffffa0a0bf0ea200:17712] 0 exiting: rc = 1 00000100:00100000:1.0:1787604204.800621:0:17713:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffffa09f883eaa00:17713] 1 exiting: rc = 0 00000100:00100000:1.0:1787604204.800667:0:19470:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffffa09f8911dc00:19470] 2 exiting: rc = 0 00000100:00100000:2.0:1787604204.800888:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801710:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801721:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801727:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801732:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801738:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801743:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801748:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801755:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801760:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801766:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801772:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801777:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801782:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801787:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801792:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801796:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801801:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801806:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801811:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801817:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801822:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801827:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801832:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801837:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801841:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801846:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801852:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801857:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801862:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801867:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801874:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801879:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801885:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801891:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.801896:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.805206:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.805212:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.805218:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.805224:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.805243:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.805253:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.805258:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.805263:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.805268:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.805273:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.805279:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.805284:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.805290:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.805299:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.805309:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.805315:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.805322:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.805327:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.805332:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.805338:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.805345:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.805352:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.805358:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.805363:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.805368:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.805373:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.805379:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.805385:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604204.807933:0:17715:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffffa0a0854e1600:17715] 1 exiting: rc = 0 00000100:00100000:1.0:1787604204.808365:0:17714:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffffa0a084924c00:17714] 0 exiting: rc = 1 00000100:00100000:2.0:1787604204.808484:0:17716:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffffa09f8824ba00:17716] 2 exiting: rc = 0 00000100:00100000:2.0:1787604204.808600:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808611:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808631:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808638:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808645:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808651:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808670:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808676:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808704:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808714:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808720:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808742:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808748:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808754:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808759:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808766:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808770:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808775:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808781:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808787:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808792:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808797:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808802:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808819:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808825:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808831:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808837:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808843:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808848:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808853:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808858:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808864:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808869:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808874:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.808880:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809142:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809154:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809162:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809168:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809174:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809179:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809194:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809200:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809207:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809213:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809219:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809225:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809231:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809237:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809242:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809248:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809254:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809260:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809266:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809272:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809278:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809284:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809290:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809296:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809301:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809306:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809312:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809318:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.809323:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604204.821683:0:17717:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffffa0a085a0e200:17717] 0 exiting: rc = 1 00000100:00100000:2.0:1787604204.822059:0:17718:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffffa09f821d0400:17718] 1 exiting: rc = 0 00000100:00100000:2.0:1787604204.822118:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822125:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822130:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822136:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822141:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822146:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822151:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822157:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822165:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822172:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822177:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822194:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822199:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822205:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822209:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822214:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822219:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822224:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822229:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822234:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822240:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822248:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822254:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822260:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822265:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822270:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822274:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822279:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822284:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822289:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822295:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822301:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822306:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822311:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822316:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822321:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822327:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822332:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822337:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822343:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822347:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822352:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822357:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822363:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822367:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822373:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822385:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822391:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822396:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822401:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822416:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822422:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822427:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822432:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822437:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822443:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822447:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822452:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822456:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822461:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822465:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822470:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822475:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.822480:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787604204.824099:0:17719:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffffa09f821d0800:17719] 0 exiting: rc = 1 00000100:00100000:3.0:1787604204.825461:0:17720:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffffa0a088a12e00:17720] 1 exiting: rc = 0 00000100:00100000:2.0:1787604204.825641:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825661:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825668:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825674:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825680:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825706:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825721:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825728:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825734:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825742:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825747:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825752:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825758:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825765:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825771:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825777:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825782:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825799:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825828:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825835:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825843:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825850:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825856:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825861:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825867:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825873:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825878:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825884:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825889:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825895:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825924:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825933:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825938:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825944:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825950:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825956:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825964:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825969:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825975:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825981:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.825997:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.826003:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.826024:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.826031:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.826037:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.826043:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.826049:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.826055:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.826060:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.826065:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.826073:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.826078:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.826091:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.826096:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.826115:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.826122:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.826128:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.826134:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.826139:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.826144:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.826148:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.826154:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.826159:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787604204.826164:0:20714:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787604204.842626:0:20714:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1787604222.420614:0:21437:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787604230.483267:0:21902:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787604230.483276:0:21902:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787604230.483404:0:21902:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa0a0bc52f000 00000020:01000004:2.0:1787604230.483425:0:21902:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787604230.483435:0:21902:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787604230.483454:0:21902:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffffa0a086233370) 00000020:00000080:2.0:1787604230.483470:0:21902:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787604230.520619:0:21902:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787604230.522630:0:21902:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:1.0:1787604230.523648:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 599: rc = 0 00100000:10000000:1.0:1787604230.523893:0:21902:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1787604230.524032:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 599: rc = 0 00100000:10000000:1.0:1787604230.524198:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0001 under 599: rc = 0 00100000:10000000:1.0:1787604230.524296:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 599: rc = 0 00100000:10000000:1.0:1787604230.524389:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 599: rc = 0 00100000:10000000:1.0:1787604230.524598:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 599: rc = 0 00100000:10000000:1.0:1787604230.524788:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 599: rc = 0 00100000:10000000:1.0:1787604230.525217:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 601: rc = 0 00100000:10000000:1.0:1787604230.527186:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 174: rc = 0 00100000:10000000:1.0:1787604230.527318:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 174: rc = 0 00100000:10000000:1.0:1787604230.527770:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 178: rc = 0 00100000:10000000:1.0:1787604230.528343:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 178: rc = 0 00100000:10000000:1.0:1787604230.528682:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 178: rc = 0 00100000:10000000:1.0:1787604230.529427:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 178: rc = 0 00100000:10000000:1.0:1787604230.529741:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 178: rc = 0 00100000:10000000:1.0:1787604230.530099:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 178: rc = 0 00100000:10000000:1.0:1787604230.530461:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 178: rc = 0 00100000:10000000:1.0:1787604230.530754:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 178: rc = 0 00100000:10000000:1.0:1787604230.531354:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 178: rc = 0 00100000:10000000:1.0:1787604230.531823:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 178: rc = 0 00100000:10000000:1.0:1787604230.532560:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 178: rc = 0 00100000:10000000:1.0:1787604230.532888:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 178: rc = 0 00100000:10000000:1.0:1787604230.533512:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 195: rc = 0 00100000:10000000:1.0:1787604230.533853:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 195: rc = 0 00100000:10000000:1.0:1787604230.534341:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 195: rc = 0 00100000:10000000:1.0:1787604230.534682:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 195: rc = 0 00100000:10000000:1.0:1787604230.537882:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 195: rc = 0 00100000:10000000:1.0:1787604230.538240:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 195: rc = 0 00100000:10000000:1.0:1787604230.538495:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 195: rc = 0 00100000:10000000:1.0:1787604230.538800:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 195: rc = 0 00100000:10000000:1.0:1787604230.539058:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 195: rc = 0 00100000:10000000:1.0:1787604230.539327:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 195: rc = 0 00100000:10000000:1.0:1787604230.539583:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 195: rc = 0 00100000:10000000:1.0:1787604230.539895:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 195: rc = 0 00100000:10000000:1.0:1787604230.540144:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 195: rc = 0 00100000:10000000:1.0:1787604230.541613:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 195: rc = 0 00100000:10000000:1.0:1787604230.542004:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 195: rc = 0 00100000:10000000:1.0:1787604230.542479:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 195: rc = 0 00100000:10000000:1.0:1787604230.543008:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 195: rc = 0 00100000:10000000:1.0:1787604230.543709:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 195: rc = 0 00100000:10000000:1.0:1787604230.544402:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 195: rc = 0 00100000:10000000:1.0:1787604230.544770:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 195: rc = 0 00100000:10000000:1.0:1787604230.547472:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 195: rc = 0 00100000:10000000:1.0:1787604230.547916:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 195: rc = 0 00100000:10000000:1.0:1787604230.549332:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 195: rc = 0 00100000:10000000:1.0:1787604230.549782:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 195: rc = 0 00100000:10000000:1.0:1787604230.550261:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 195: rc = 0 00100000:10000000:1.0:1787604230.550759:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 195: rc = 0 00100000:10000000:1.0:1787604230.551104:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 195: rc = 0 00100000:10000000:1.0:1787604230.551518:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 195: rc = 0 00100000:10000000:1.0:1787604230.552855:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 195: rc = 0 00100000:10000000:1.0:1787604230.553344:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 195: rc = 0 00100000:10000000:1.0:1787604230.553574:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 195: rc = 0 00100000:10000000:1.0:1787604230.554086:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 195: rc = 0 00100000:10000000:1.0:1787604230.554859:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000401:0x1:0x0] under 642: rc = 0 00100000:10000000:1.0:1787604230.555835:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 642: rc = 0 00100000:10000000:1.0:1787604230.557080:0:21902:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1787604230.557395:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 74: rc = 0 00100000:10000000:1.0:1787604230.558498:0:21902:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1787604230.558605:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 74: rc = 0 00100000:10000000:1.0:1787604230.558878:0:21902:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1787604230.559079:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 74: rc = 0 00100000:10000000:1.0:1787604230.559512:0:21902:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1787604230.559582:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 175: rc = 0 00100000:10000000:1.0:1787604230.560099:0:21902:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1787604230.560247:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 175: rc = 0 00100000:10000000:1.0:1787604230.560436:0:21902:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1787604230.561240:0:21902:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 175: rc = 0 00000020:00000080:1.0:1787604230.561601:0:21902:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787604230.561610:0:21902:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787604230.561623:0:21902:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6c241a9cc41dd198 00000020:01000004:1.0:1787604230.561644:0:21902:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1787604230.561651:0:21902:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787604230.561657:0:21902:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0a0bc52f000 from MGS 00000020:01000004:1.0:1787604230.561661:0:21902:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787604230.561674:0:21902:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffffa0a0906a4d28) 00000020:00000080:1.0:1787604230.561719:0:21902:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787604230.561790:0:21902:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0a0bc52f000 from MGS, refs=2 00080000:01000000:1.0:1787604230.561795:0:21902:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787604230.561800:0:21902:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6c241a9cc41dd1a6 00000100:00100000:1.0:1787604230.561931:0:21902:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787604230.562090:0:21902:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787604230.562098:0:21902:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787604230.563922:0:21902:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787604230.564000:0:21902:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787604230.565855:0:21902:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787604230.566225:0:21902:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787604230.566232:0:21902:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787604230.575132:0:21902:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787604230.575153:0:21902:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787604230.578083:0:21902:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787604230.578099:0:21902:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787604230.580395:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604230.580403:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604230.580405:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604230.586893:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604230.586900:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604230.586903:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604230.588882:0:21902:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787604230.592283:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787604230.610253:0:21902:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1787604230.610277:0:21902:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787604230.610281:0:21902:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787604230.615499:0:21911:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787604230.616821:0:21902:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787604230.617172:0:21902:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787604230.618070:0:21902:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787604230.618451:0:21902:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787604230.618750:0:21902:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787604230.618757:0:21902:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787604230.624581:0:21902:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787604230.624608:0:21902:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787604230.625394:0:21902:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787604230.625411:0:21902:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1787604230.629964:0:21916:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1787604230.630174:0:21902:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787604230.630210:0:21902:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.116@tcp' 00000020:01000004:1.0:1787604230.630212:0:21902:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787604230.630258:0:21902:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.116@tcp (typ=mgc) 00000020:00000080:1.0:1787604230.630275:0:21902:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.116@tcp (ffffa0a0906a3370) 00000020:00000080:1.0:1787604230.630293:0:21902:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787604230.630392:0:21902:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0a0bcb5b800@MGC192.168.203.116@tcp: add connection 192.168.203.116@tcp at head 00010000:00010000:1.0:1787604230.630597:0:21902:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.116@tcp-0 is initialized 00000040:01000000:1.0:1787604230.630605:0:21902:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.116@tcp ctxt 1 is initialized 10000000:01000000:2.0:1787604230.633429:0:21917:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787604230.634562:0:21902:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.116@tcp (uuid 57b6d7db-5b8e-4468-b46a-6c89167d0f60) 00000020:00000080:3.0:1787604230.634592:0:21902:0:(genops.c:1385:class_connect()) connect: client 57b6d7db-5b8e-4468-b46a-6c89167d0f60, cookie 0x6c241a9cc41dd1b4 00000100:00080000:3.0:1787604230.634609:0:21902:0:(import.c:510:import_select_connection()) MGC192.168.203.116@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787604230.634617:0:21902:0:(import.c:624:import_select_connection()) MGC192.168.203.116@tcp: import ffffa0a0bcb5b800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1787604230.634666:0:21902:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a0a009ce00 x1874438316594176/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787604230.634900:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3449:1874438316594176:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787604230.634987:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787604230.635061:0:21902:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 57b6d7db-5b8e-4468-b46a-6c89167d0f60->MGS 00000020:01000004:3.0:1787604230.635091:0:21902:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787604230.635097:0:21902:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787604230.635114:0:21902:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffffa09f81373370) 00000020:00000080:3.0:1787604230.635130:0:21902:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787604230.635249:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316594176 00000100:00100000:2.0:1787604230.635259:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316594176 00000100:00100000:2.0:1787604230.635299:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787604230.635310:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bced3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3449:x1874438316594176:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787604230.635338:0:21913:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 57b6d7db-5b8e-4468-b46a-6c89167d0f60@0@lo t0 exp 0000000000000000 cur 610 last 0 00000020:00000080:2.0:1787604230.635372:0:21913:0:(genops.c:1385:class_connect()) connect: client 57b6d7db-5b8e-4468-b46a-6c89167d0f60, cookie 0x6c241a9cc41dd1c2 00000100:00080000:2.0:1787604230.635526:0:21913:0:(import.c:65:import_set_state_nolock()) ffffa0a0bc136800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787604230.635596:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bced3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+5:3449:x1874438316594176:12345-0@lo:250:mount.lustre.0 Request processed in 287us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604230.635612:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787604230.637026:0:3449:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.116@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787604230.637103:0:3449:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.116@tcp: connect to target with instance 0 00000100:00080000:2.0:1787604230.637115:0:3449:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.116@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787604230.637120:0:3449:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787604230.637125:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa0a0bcb5b800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787604230.637128:0:3449:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787604230.637139:0:3449:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787604230.637147:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3449:1874438316594176:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787604230.656532:0:21902:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787604230.656870:0:21902:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787604230.656880:0:21902:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787604230.658421:0:21902:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787604230.658441:0:21902:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787604230.659019:0:21902:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787604230.659028:0:21902:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787604230.660089:0:21902:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787604230.660317:0:21902:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787604230.660323:0:21902:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787604230.661490:0:21902:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787604230.661500:0:21902:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787604230.716406:0:21902:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787604230.716613:0:21902:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787604230.716620:0:21902:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787604230.717647:0:21902:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787604230.717657:0:21902:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787604230.718855:0:21902:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787604230.719026:0:21902:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787604230.719031:0:21902:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787604230.719581:0:21902:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787604230.719587:0:21902:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787604230.720038:0:21902:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787604230.720213:0:21902:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787604230.720217:0:21902:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787604230.720632:0:21902:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787604230.720639:0:21902:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787604230.721359:0:21902:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787604230.721500:0:21902:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787604230.721506:0:21902:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787604230.724605:0:21902:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787604230.724622:0:21902:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787604230.744447:0:21902:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787604230.744668:0:21902:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787604230.744675:0:21902:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787604230.747745:0:21902:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787604230.747758:0:21902:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787604230.748615:0:21902:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787604230.748624:0:21902:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787604230.749414:0:21902:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787604230.749434:0:21902:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1787604230.749440:0:21902:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.116@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787604230.749560:0:21902:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.116@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787604230.749587:0:21902:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.116@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1787604230.749591:0:21902:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787604230.749592:0:21902:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787604230.749593:0:21902:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787604230.749595:0:21902:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787604230.749596:0:21902:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787604230.749596:0:21902:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787604230.749598:0:21902:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787604230.749599:0:21902:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787604230.749600:0:21902:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787604230.749602:0:21902:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787604230.749604:0:21902:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1787604230.749605:0:21902:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787604230.749606:0:21902:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787604230.749607:0:21902:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787604230.749608:0:21902:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787604230.749609:0:21902:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787604230.749610:0:21902:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787604230.749611:0:21902:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787604230.749612:0:21902:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787604230.749612:0:21902:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787604230.749614:0:21902:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787604230.749635:0:21902:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787604230.749652:0:21902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f13800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316594304:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787604230.749782:0:21902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604230.749852:0:21902:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08551de40 going to sleep for 11 seconds 00000100:00100000:1.0:1787604230.749996:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316594304 00000100:00100000:1.0:1787604230.750005:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316594304 00000100:00100000:1.0:1787604230.750051:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787604230.750182:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bced3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+5:21902:x1874438316594304:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787604230.750232:0:21915:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787604230.750235:0:21915:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787604230.750238:0:21915:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1787604230.750554:0:21936:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787604230.750956:0:21915:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1787604230.752021:0:21937:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787604230.752027:0:21937:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1787604230.752030:0:21937:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787604230.752033:0:21937:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787604230.752886:0:21937:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1787604230.753191:0:21915:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787604230.753202:0:21915:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787604230.760203:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bced3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+5:21902:x1874438316594304:12345-0@lo:253:mount.lustre.0 Request processed in 10133us (10411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604230.760232:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787604230.760318:0:21902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f13800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316594304:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787604230.760334:0:21902:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787604230.760338:0:21902:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787604230.760340:0:21902:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787604230.760341:0:21902:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787604230.760342:0:21902:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787604230.760344:0:21902:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787604230.760345:0:21902:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787604230.760346:0:21902:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787604230.760348:0:21902:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787604230.760350:0:21902:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787604230.760351:0:21902:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787604230.760371:0:21902:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0a0bc52f000 from lustre-MDT0000 10000000:01000000:0.0:1787604230.760400:0:21902:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787604230.760402:0:21902:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787604230.760407:0:21902:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffffa0a0906a3370 10000000:01000000:0.0:1787604230.760411:0:21902:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787604230.760419:0:21902:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa0a0906a3370 from 1 10000000:01000000:0.0:1787604230.760422:0:21902:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787604230.760461:0:21902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa09f89d23a00/0x6c241a9cc41dd1c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604230.760473:0:21902:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa09f89d23a00/0x6c241a9cc41dd1c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604230.760483:0:21902:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa09f89d23a00/0x6c241a9cc41dd1c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604230.760502:0:21902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f13800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316594432:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787604230.760542:0:21902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604230.760649:0:21902:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08551d600 going to sleep for 11 seconds 00000100:00100000:3.0:1787604230.760947:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316594432 00000100:00100000:3.0:1787604230.760954:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316594432 00000100:00100000:3.0:1787604230.761029:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787604230.761038:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+5:21902:x1874438316594432:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787604230.761050:0:21914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604230.761065:0:21914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a0c207d800/0x6c241a9cc41dd1d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd1c9 expref: -99 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604230.761101:0:21914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a0c207d800/0x6c241a9cc41dd1d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd1c9 expref: 6 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604230.761112:0:21914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a0c207d800/0x6c241a9cc41dd1d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd1c9 expref: 6 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604230.761121:0:21914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a0c207d800, rc 0) 00000100:00100000:3.0:1787604230.761166:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+6:21902:x1874438316594432:12345-0@lo:101:mount.lustre.0 Request processed in 128us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604230.761172:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787604230.761234:0:21902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f13800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316594432:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787604230.761247:0:21902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa09f89d23a00/0x6c241a9cc41dd1c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd1d0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604230.761256:0:21902:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa09f89d23a00/0x6c241a9cc41dd1c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd1d0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604230.761298:0:21902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f13800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316594560:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787604230.761323:0:21902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604230.761464:0:21902:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08551d600 going to sleep for 11 seconds 00000100:00100000:2.0:1787604230.761530:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316594560 00000100:00100000:2.0:1787604230.761536:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316594560 00000100:00100000:2.0:1787604230.761556:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787604230.761562:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+6:21902:x1874438316594560:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787604230.761859:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+6:21902:x1874438316594560:12345-0@lo:501:mount.lustre.0 Request processed in 295us (533us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787604230.761867:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787604230.761992:0:21902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f13800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316594560:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787604230.762014:0:21902:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787604230.762063:0:21902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa09f89d23a00/0x6c241a9cc41dd1c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd1d0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604230.762073:0:21902:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa09f89d23a00/0x6c241a9cc41dd1c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd1d0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787604230.762081:0:21902:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0a0bc52f000 10000000:01000000:0.0:1787604230.762085:0:21902:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787604230.762089:0:21902:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffffa0a0bc52f000 10000000:01000000:0.0:1787604230.762091:0:21902:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787604230.762094:0:21902:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffffa0a0bc52f000 from 1 10000000:01000000:0.0:1787604230.762096:0:21902:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787604230.762113:0:21902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa09f89d22e00/0x6c241a9cc41dd1d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604230.762121:0:21902:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa09f89d22e00/0x6c241a9cc41dd1d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604230.762137:0:21902:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa09f89d22e00/0x6c241a9cc41dd1d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604230.762150:0:21902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f13800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316594688:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787604230.762176:0:21902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604230.762204:0:21902:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08551d600 going to sleep for 11 seconds 00000100:00100000:3.0:1787604230.762250:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316594688 00000100:00100000:3.0:1787604230.762254:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316594688 00000100:00100000:3.0:1787604230.762284:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787604230.762291:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+6:21902:x1874438316594688:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787604230.762299:0:21913:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604230.762308:0:21913:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a0c207d600/0x6c241a9cc41dd1de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd1d7 expref: -99 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604230.762323:0:21913:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a0c207d600/0x6c241a9cc41dd1de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd1d7 expref: 7 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604230.762331:0:21913:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a0c207d600/0x6c241a9cc41dd1de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd1d7 expref: 7 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604230.762338:0:21913:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a0c207d600, rc 0) 00000100:00100000:3.0:1787604230.762377:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+7:21902:x1874438316594688:12345-0@lo:101:mount.lustre.0 Request processed in 85us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604230.762383:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787604230.762487:0:21902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f13800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316594688:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787604230.762498:0:21902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa09f89d22e00/0x6c241a9cc41dd1d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd1de expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604230.762506:0:21902:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa09f89d22e00/0x6c241a9cc41dd1d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd1de expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787604230.762516:0:21902:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787604230.762595:0:21902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa09f89d22e00/0x6c241a9cc41dd1d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd1de expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604230.762603:0:21902:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa09f89d22e00/0x6c241a9cc41dd1d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd1de expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787604230.762608:0:21902:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787604230.762612:0:21902:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787604230.762617:0:21902:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffffa0a0bc52f000 10000000:01000000:1.0:1787604230.762619:0:21902:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787604230.762623:0:21902:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787604230.762625:0:21902:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787604230.762640:0:21902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0813d2c00/0x6c241a9cc41dd1e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604230.762647:0:21902:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0a0813d2c00/0x6c241a9cc41dd1e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604230.762654:0:21902:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0a0813d2c00/0x6c241a9cc41dd1e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604230.762673:0:21902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7270700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316594816:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787604230.762741:0:21902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604230.762761:0:21902:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a083af4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787604230.762839:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316594816 00000100:00100000:3.0:1787604230.762844:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316594816 00000100:00100000:3.0:1787604230.762875:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787604230.762882:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82187850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+7:21902:x1874438316594816:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787604230.763044:0:21915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604230.763055:0:21915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a0c207c800/0x6c241a9cc41dd1ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd1e5 expref: -99 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604230.763070:0:21915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a0c207c800/0x6c241a9cc41dd1ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd1e5 expref: 8 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604230.763079:0:21915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a0c207c800/0x6c241a9cc41dd1ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd1e5 expref: 8 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604230.763085:0:21915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a0c207c800, rc 0) 00000100:00100000:3.0:1787604230.763122:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82187850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+8:21902:x1874438316594816:12345-0@lo:101:mount.lustre.0 Request processed in 240us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604230.763129:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787604230.763190:0:21902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7270700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316594816:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787604230.763202:0:21902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0a0813d2c00/0x6c241a9cc41dd1e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd1ec expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604230.763210:0:21902:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0a0813d2c00/0x6c241a9cc41dd1e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd1ec expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604230.763251:0:21902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7270700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316594944:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787604230.763275:0:21902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604230.763328:0:21902:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a083af4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787604230.763453:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316594944 00000100:00100000:0.0:1787604230.763457:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316594944 00000100:00100000:0.0:1787604230.763513:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787604230.763521:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82184c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+8:21902:x1874438316594944:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787604230.763899:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82184c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+9:21902:x1874438316594944:12345-0@lo:501:mount.lustre.0 Request processed in 377us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604230.763906:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787604230.764056:0:21902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7270700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316594944:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787604230.764086:0:21902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7270700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316595072:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787604230.764130:0:21902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604230.764310:0:21902:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a083af4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787604230.764379:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316595072 00000100:00100000:3.0:1787604230.764384:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316595072 00000100:00100000:3.0:1787604230.764409:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787604230.764416:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82185450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+9:21902:x1874438316595072:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787604230.764719:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82185450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+9:21902:x1874438316595072:12345-0@lo:503:mount.lustre.0 Request processed in 303us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604230.764726:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787604230.764802:0:21902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7270700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316595072:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787604230.765239:0:21938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7270700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21938:1874438316595200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787604230.765277:0:21938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604230.765304:0:21938:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08483cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787604230.765348:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316595200 00000100:00100000:3.0:1787604230.765353:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316595200 00000100:00100000:3.0:1787604230.765382:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787604230.765390:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82186050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+9:21938:x1874438316595200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787604230.765637:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82186050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+9:21938:x1874438316595200:12345-0@lo:502:llog_process_th.0 Request processed in 247us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604230.765643:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787604230.765765:0:21938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7270700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21938:1874438316595200:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787604230.765788:0:21938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787604230.765816:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604230.765819:0:21938:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787604230.765827:0:21938:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787604230.765830:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787604230.765846:0:21938:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffffa0a0906a19b8) 00000020:00000080:1.0:1787604230.765864:0:21938:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787604230.765870:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787604230.765936:0:21938:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787604230.765946:0:21938:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6c241a9cc41dd1fa 00000020:00000080:1.0:1787604230.766147:0:21938:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787604230.766151:0:21938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787604230.766155:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604230.766157:0:21938:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787604230.766159:0:21938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787604230.766163:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604230.766164:0:21938:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787604230.766167:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787604230.766175:0:21938:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffffa0a0906a0000) 00000020:00000080:1.0:1787604230.766184:0:21938:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787604230.766188:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787604230.766190:0:21938:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787604230.766192:0:21938:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787604230.766198:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787604230.766240:0:21938:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0a0bc52f000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787604230.766265:0:21938:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffffa0a0916d19b8) 00000020:00000080:1.0:1787604230.766275:0:21938:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787604230.766324:0:21938:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787604230.766333:0:21938:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6c241a9cc41dd20f 00000020:00000080:1.0:1787604230.766421:0:21938:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787604230.766427:0:21938:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787604230.766432:0:21938:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x6c241a9cc41dd216 00080000:01000000:1.0:1787604230.766437:0:21938:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787604230.766440:0:21938:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6c241a9cc41dd21d 00010000:00010000:1.0:1787604230.817124:0:21938:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1787604230.817555:0:21938:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934637 00000001:00080000:1.0:1787604230.817824:0:21938:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787604230.818341:0:21938:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffffa0a0916d3370) 00000020:00000080:1.0:1787604230.818359:0:21938:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787604230.818416:0:21938:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787604230.818426:0:21938:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6c241a9cc41dd22b 00000020:00000080:3.0:1787604230.818886:0:21938:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787604230.824050:0:21938:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x6c241a9cc41dd232 00000020:00000080:1.0:1787604230.824495:0:21938:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787604230.824507:0:21938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787604230.824514:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604230.824516:0:21938:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787604230.824519:0:21938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787604230.824525:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604230.824526:0:21938:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787604230.824530:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787604230.824565:0:21938:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787604230.824577:0:21938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787604230.824579:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604230.824581:0:21938:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787604230.824583:0:21938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787604230.824585:0:21938:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1787604230.824586:0:21938:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787604230.824587:0:21938:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787604230.824589:0:21938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787604230.824591:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604230.824592:0:21938:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787604230.824594:0:21938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787604230.824597:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604230.824599:0:21938:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1787604230.824602:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787604230.824606:0:21938:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.116@tcp to nid 0x20000c0a8cb74 (192.168.203.116@tcp) 00000020:00000080:1.0:1787604230.824633:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787604230.824648:0:21938:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffffa0a0916d4d28) 00000020:00000080:1.0:1787604230.824662:0:21938:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787604230.824676:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787604230.824755:0:21938:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1787604230.824761:0:21938:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787604230.824766:0:21938:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6c241a9cc41dd240 00010000:00080000:1.0:1787604230.824819:0:21938:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa09f81b85800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:1.0:1787604230.826397:0:21938:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1787604230.831255:0:21938:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787604230.831270:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787604230.831303:0:21938:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787604230.831323:0:21938:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6c241a9cc41dd247 00000100:00080000:2.0:1787604230.831333:0:21938:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787604230.831339:0:21938:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffffa09f81b85800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1787604230.831372:0:21938:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa09f89d93b80 x1874438316595328/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787604230.831403:0:21938:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1787604230.831458:0:21938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787604230.831471:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604230.831473:0:21938:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1787604230.831476:0:21938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787604230.831479:0:21938:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1787604230.831481:0:21938:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787604230.831483:0:21938:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787604230.831484:0:21938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787604230.831486:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604230.831488:0:21938:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787604230.831490:0:21938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787604230.831495:0:21938:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787604230.831498:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604230.831500:0:21938:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787604230.831503:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787604230.831507:0:21938:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.116@tcp to nid 0x20000c0a8cb74 (192.168.203.116@tcp) 00000020:01000000:2.0:1787604230.831531:0:21938:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787604230.831533:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787604230.831546:0:21938:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffffa0a0862319b8) 00000020:00000080:2.0:1787604230.831557:0:21938:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1787604230.831562:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787604230.831618:0:21938:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787604230.831624:0:21938:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787604230.831630:0:21938:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6c241a9cc41dd255 00010000:00080000:2.0:1787604230.831659:0:21938:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa09f884b0000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:2.0:1787604230.831895:0:21938:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1787604230.832273:0:21938:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787604230.832318:0:21938:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787604230.833144:0:21938:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787604230.833202:0:21938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1787604230.833267:0:21938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000100:00100000:0.0:1787604230.833479:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316595328:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787604230.833543:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1787604230.833886:0:21944:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1787604230.833891:0:21944:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1787604230.834105:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316595328 00000100:00100000:2.0:1787604230.834111:0:21925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316595328 00000100:00100000:2.0:1787604230.834147:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787604230.834166:0:21925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a084f11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3449:x1874438316595328:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1787604230.834184:0:21925:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:00000080:3.0:1787604230.834979:0:21938:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787604230.834993:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787604230.835028:0:21938:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787604230.835048:0:21938:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6c241a9cc41dd25c 00000100:00080000:3.0:1787604230.835056:0:21938:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787604230.835061:0:21938:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa09f884b0000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1787604230.835091:0:21938:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a0a009e680 x1874438316595456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787604230.835112:0:21938:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787604230.835155:0:21938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787604230.835159:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787604230.835161:0:21938:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787604230.835164:0:21938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787604230.835167:0:21938:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1787604230.835169:0:21938:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787604230.835170:0:21938:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787604230.835172:0:21938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787604230.835174:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787604230.835176:0:21938:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787604230.835178:0:21938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787604230.835182:0:21938:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787604230.835186:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787604230.835187:0:21938:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787604230.835190:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787604230.835194:0:21938:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.116@tcp to nid 0x20000c0a8cb74 (192.168.203.116@tcp) 00000020:01000000:3.0:1787604230.835225:0:21938:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787604230.835228:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787604230.835240:0:21938:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffffa09f81374d28) 00000020:00000080:3.0:1787604230.835251:0:21938:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1787604230.835256:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787604230.835312:0:21938:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787604230.835317:0:21938:0:(osd_handler.c:1564:osd_obd_connect()) connect #7 00000020:00000080:3.0:1787604230.835323:0:21938:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6c241a9cc41dd26a 00010000:00080000:3.0:1787604230.835350:0:21938:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0a0bca77000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:3.0:1787604230.835554:0:21938:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1787604230.835758:0:21938:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787604230.835781:0:21938:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787604230.836259:0:21938:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787604230.836326:0:21938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1787604230.836396:0:21938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000100:00100000:0.0:1787604230.836526:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316595456:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787604230.836594:0:3449:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874438316595456 offset 0 length 520: 4 00000040:00080000:3.0:1787604230.840157:0:21946:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787604230.840164:0:21946:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787604230.841052:0:21938:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787604230.841066:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787604230.841100:0:21938:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787604230.841121:0:21938:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6c241a9cc41dd271 00000100:00080000:1.0:1787604230.841132:0:21938:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787604230.841139:0:21938:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0a0bca77000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1787604230.841174:0:21938:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a0b7270700 x1874438316595584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787604230.841232:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316595584:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787604230.841286:0:3449:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874438316595584 offset 0 length 520: 4 00000100:00080000:1.0:1787604230.841338:0:21938:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787604230.841391:0:21938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787604230.841395:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604230.841397:0:21938:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787604230.841400:0:21938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787604230.841404:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604230.841406:0:21938:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787604230.841409:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787604230.841411:0:21938:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787604230.841413:0:21938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787604230.841415:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604230.841417:0:21938:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787604230.841419:0:21938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787604230.841421:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604230.841422:0:21938:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787604230.841436:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787604230.841465:0:21938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7271180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21938:1874438316595712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787604230.841514:0:21938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604230.841533:0:21938:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a083af4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787604230.841555:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316595712 00000100:00100000:1.0:1787604230.841561:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316595712 00000100:00100000:1.0:1787604230.841596:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787604230.841605:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82185850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+9:21938:x1874438316595712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787604230.841873:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82185850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+9:21938:x1874438316595712:12345-0@lo:502:llog_process_th.0 Request processed in 266us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604230.841881:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787604230.841931:0:21938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7271180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21938:1874438316595712:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787604230.841956:0:21938:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787604230.841960:0:21938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604230.841962:0:21938:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787604230.841965:0:21938:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1787604230.842202:0:21902:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1787604230.842219:0:21902:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787604230.842272:0:21902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0813d2c00/0x6c241a9cc41dd1e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd1ec expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604230.842282:0:21902:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0a0813d2c00/0x6c241a9cc41dd1e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd1ec expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787604230.842299:0:21902:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0a0bc52f000 from 1 10000000:01000000:0.0:1787604230.842302:0:21902:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787604230.842328:0:21902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604230.842335:0:21902:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604230.842345:0:21902:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604230.842358:0:21902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316595840:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787604230.842388:0:21902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604230.842410:0:21902:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08551d480 going to sleep for 11 seconds 00000100:00100000:3.0:1787604230.842880:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316595840 00000100:00100000:3.0:1787604230.842886:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316595840 00000100:00100000:3.0:1787604230.843296:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787604230.843307:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82187050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+9:21902:x1874438316595840:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787604230.843320:0:21915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604230.843335:0:21915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a0c207c000/0x6c241a9cc41dd27f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd278 expref: -99 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604230.843358:0:21915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a0c207c000/0x6c241a9cc41dd27f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd278 expref: 10 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604230.843369:0:21915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a0c207c000/0x6c241a9cc41dd27f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd278 expref: 10 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604230.843391:0:21915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a0c207c000, rc 0) 00000100:00100000:3.0:1787604230.843447:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82187050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+10:21902:x1874438316595840:12345-0@lo:101:mount.lustre.0 Request processed in 142us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604230.843453:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787604230.843522:0:21902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316595840:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787604230.843537:0:21902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd278 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd27f expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604230.843547:0:21902:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd278 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd27f expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604230.844108:0:21902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316595968:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787604230.844153:0:21902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604230.844390:0:21902:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08551d480 going to sleep for 11 seconds 00000100:00100000:1.0:1787604230.844437:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316595968 00000100:00100000:1.0:1787604230.844442:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316595968 00000100:00100000:1.0:1787604230.844471:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787604230.844479:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82186850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+10:21902:x1874438316595968:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787604230.844496:0:21913:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787604230.844502:0:21913:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787604230.844572:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82186850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+10:21902:x1874438316595968:12345-0@lo:256:mount.lustre.0 Request processed in 93us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604230.844579:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787604230.846117:0:21902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316595968:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787604230.847062:0:21902:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787604230.847259:0:21902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd278 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd27f expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604230.847272:0:21902:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd27f expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787604230.847281:0:21902:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0a0bc52f000 from 1 10000000:01000000:0.0:1787604230.847284:0:21902:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787604230.847321:0:21902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa09f89d23200/0x6c241a9cc41dd286 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604230.847329:0:21902:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa09f89d23200/0x6c241a9cc41dd286 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604230.847339:0:21902:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa09f89d23200/0x6c241a9cc41dd286 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604230.847359:0:21902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316596096:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787604230.847419:0:21902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604230.847459:0:21902:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08551d480 going to sleep for 11 seconds 00000100:00100000:3.0:1787604230.848261:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316596096 00000100:00100000:3.0:1787604230.848269:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316596096 00000100:00100000:3.0:1787604230.848320:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787604230.848330:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82184850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+10:21902:x1874438316596096:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787604230.848344:0:21915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604230.848360:0:21915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a0c207dc00/0x6c241a9cc41dd28d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd286 expref: -99 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604230.848385:0:21915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a0c207dc00/0x6c241a9cc41dd28d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd286 expref: 11 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604230.848396:0:21915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a0c207dc00/0x6c241a9cc41dd28d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd286 expref: 11 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604230.848405:0:21915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a0c207dc00, rc 0) 00000100:00100000:3.0:1787604230.848453:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82184850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+11:21902:x1874438316596096:12345-0@lo:101:mount.lustre.0 Request processed in 125us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604230.848460:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787604230.848564:0:21902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316596096:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787604230.848579:0:21902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa09f89d23200/0x6c241a9cc41dd286 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd28d expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604230.848866:0:21902:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa09f89d23200/0x6c241a9cc41dd286 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd28d expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604230.848935:0:21902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316596224:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787604230.848969:0:21902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604230.849011:0:21902:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08551d480 going to sleep for 11 seconds 00000100:00100000:3.0:1787604230.849277:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316596224 00000100:00100000:3.0:1787604230.849283:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316596224 00000100:00100000:3.0:1787604230.849320:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787604230.849328:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82187c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+11:21902:x1874438316596224:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787604230.849736:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82187c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+11:21902:x1874438316596224:12345-0@lo:501:mount.lustre.0 Request processed in 407us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604230.849749:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787604230.850376:0:21902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316596224:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787604230.850414:0:21902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316596352:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787604230.850461:0:21902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604230.850495:0:21902:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08551d480 going to sleep for 11 seconds 00000100:00100000:0.0:1787604230.850511:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316596352 00000100:00100000:0.0:1787604230.850516:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316596352 00000100:00100000:0.0:1787604230.850553:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787604230.850561:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82187450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+11:21902:x1874438316596352:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787604230.850745:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82187450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+11:21902:x1874438316596352:12345-0@lo:503:mount.lustre.0 Request processed in 184us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604230.850752:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787604230.850793:0:21902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316596352:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787604230.851017:0:21948:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21948:1874438316596480:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787604230.851167:0:21948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604230.851187:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316596480 00000100:00100000:0.0:1787604230.851191:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316596480 00000100:00100000:0.0:1787604230.851210:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787604230.851216:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82186c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+11:21948:x1874438316596480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787604230.851394:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82186c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+11:21948:x1874438316596480:12345-0@lo:502:llog_process_th.0 Request processed in 177us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604230.851401:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787604230.851430:0:21948:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08551dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787604230.851442:0:21948:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21948:1874438316596480:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787604230.851463:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787604230.851477:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787604230.851479:0:21948:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787604230.851487:0:21948:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0a0bc52f000 00000020:00000080:0.0:1787604230.851490:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787604230.851498:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787604230.851501:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787604230.851503:0:21948:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787604230.851505:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787604230.851508:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787604230.851509:0:21948:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787604230.851513:0:21948:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0a0bc52f000 00000020:00000080:0.0:1787604230.851515:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787604230.851573:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787604230.851577:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787604230.851579:0:21948:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787604230.851594:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787604230.851597:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787604230.851599:0:21948:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787604230.851602:0:21948:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0a0bc52f000 00000020:00000080:0.0:1787604230.851605:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787604230.851623:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787604230.851626:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787604230.851627:0:21948:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787604230.851630:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787604230.851632:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787604230.851633:0:21948:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787604230.851637:0:21948:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0a0bc52f000 00000020:00000080:0.0:1787604230.851639:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787604230.851671:0:21948:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21948:1874438316596608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787604230.851726:0:21948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604230.851744:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316596608 00000100:00100000:0.0:1787604230.851748:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316596608 00000100:00100000:0.0:1787604230.851766:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787604230.851779:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82184050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+11:21948:x1874438316596608:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787604230.851908:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82184050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+11:21948:x1874438316596608:12345-0@lo:502:llog_process_th.0 Request processed in 129us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604230.851915:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787604230.851943:0:21948:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08551dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787604230.851955:0:21948:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21948:1874438316596608:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787604230.851972:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787604230.851976:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787604230.851978:0:21948:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787604230.851981:0:21948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787604230.852041:0:21902:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787604230.852057:0:21902:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787604230.852073:0:21902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa09f89d23200/0x6c241a9cc41dd286 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd28d expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604230.852084:0:21902:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa09f89d23200/0x6c241a9cc41dd286 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd28d expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787604230.852129:0:21902:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787604230.852132:0:21902:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0a0bc52f000 10000000:01000000:0.0:1787604230.852136:0:21902:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0a0bc52f000 10000000:01000000:0.0:1787604230.852139:0:21902:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787604230.852145:0:21902:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0a0bc52f000 from 1 10000000:01000000:0.0:1787604230.852148:0:21902:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787604230.852170:0:21902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa09f89d23e00/0x6c241a9cc41dd294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604230.852178:0:21902:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa09f89d23e00/0x6c241a9cc41dd294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604230.852198:0:21902:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa09f89d23e00/0x6c241a9cc41dd294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604230.852211:0:21902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316596736:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787604230.852238:0:21902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604230.852253:0:21902:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08551dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787604230.852267:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316596736 00000100:00100000:0.0:1787604230.852270:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316596736 00000100:00100000:0.0:1787604230.852287:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787604230.852294:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+11:21902:x1874438316596736:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787604230.852303:0:21915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604230.852316:0:21915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09f89d22200/0x6c241a9cc41dd29b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd294 expref: -99 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604230.852337:0:21915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09f89d22200/0x6c241a9cc41dd29b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd294 expref: 12 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604230.852347:0:21915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09f89d22200/0x6c241a9cc41dd29b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd294 expref: 12 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604230.852355:0:21915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09f89d22200, rc 0) 00000100:00100000:0.0:1787604230.852383:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+12:21902:x1874438316596736:12345-0@lo:101:mount.lustre.0 Request processed in 89us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604230.852389:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787604230.852425:0:21902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316596736:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787604230.852437:0:21902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa09f89d23e00/0x6c241a9cc41dd294 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd29b expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604230.852453:0:21902:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa09f89d23e00/0x6c241a9cc41dd294 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd29b expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604230.852494:0:21902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316596864:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787604230.852519:0:21902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604230.852532:0:21902:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08551dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787604230.852544:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316596864 00000100:00100000:0.0:1787604230.852547:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316596864 00000100:00100000:0.0:1787604230.852565:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787604230.852570:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+12:21902:x1874438316596864:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787604230.852801:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+12:21902:x1874438316596864:12345-0@lo:501:mount.lustre.0 Request processed in 229us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604230.852819:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787604230.852850:0:21902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316596864:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787604230.852876:0:21902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316596992:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787604230.852913:0:21902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604230.852926:0:21902:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08551dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787604230.852939:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316596992 00000100:00100000:0.0:1787604230.852943:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316596992 00000100:00100000:0.0:1787604230.852959:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787604230.852964:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+12:21902:x1874438316596992:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787604230.853093:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+12:21902:x1874438316596992:12345-0@lo:503:mount.lustre.0 Request processed in 126us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604230.853099:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787604230.853138:0:21902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316596992:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787604230.857472:0:21949:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21949:1874438316597120:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787604230.857550:0:21949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604230.857582:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316597120 00000100:00100000:2.0:1787604230.857616:0:21925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a084f11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3449:x1874438316595328:12345-0@lo:38:llog_process_th.0 Request processed in 23448us (24070us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787604230.857627:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787604230.857715:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f81b85800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787604230.857722:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787604230.857725:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316595328:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787604230.857871:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316597120 00000100:00100000:0.0:1787604230.859952:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787604230.859975:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+12:21949:x1874438316597120:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787604230.860655:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+12:21949:x1874438316597120:12345-0@lo:502:llog_process_th.0 Request processed in 685us (3103us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604230.860664:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787604230.860969:0:21949:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08483a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787604230.860991:0:21949:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21949:1874438316597120:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787604230.861057:0:21949:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787604230.861073:0:21949:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffffa0a0bcfe4d28) 00000020:00000080:0.0:1787604230.861518:0:21949:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1787604230.861780:0:21949:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0a0bc52f000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787604230.861785:0:21949:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0a0bc52f000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787604230.861788:0:21949:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0a0bc52f000 4 00010000:00080000:0.0:1787604230.861837:0:21949:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0a0bf091800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:0.0:1787604230.866000:0:21949:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1787604230.866212:0:21949:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787604230.866313:0:21949:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787604230.866334:0:21949:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x6c241a9cc41dd2a9 00000100:00080000:0.0:1787604230.866355:0:21949:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787604230.866362:0:21949:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffffa0a0bf091800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1787604230.866400:0:21949:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a084f10380 x1874438316597248/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787604230.866448:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3449:1874438316597248:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787604230.866521:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604230.866599:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316597248 00000100:00100000:0.0:1787604230.866607:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316597248 00000100:00100000:0.0:1787604230.866640:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787604230.866647:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a084f13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3449:x1874438316597248:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787604230.867545:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a084f13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3449:x1874438316597248:12345-0@lo:38:llog_process_th.0 Request processed in 893us (1021us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787604230.867556:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787604230.867620:0:3449:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787604230.867628:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa0a0bf091800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787604230.867645:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787604230.867650:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3449:1874438316597248:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787604230.867755:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787604230.867760:0:15520:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787604230.867763:0:15520:0:(import.c:65:import_set_state_nolock()) ffffa09f81b85800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787604230.867768:0:15520:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 610 00000100:00080000:0.0:1787604230.867772:0:15520:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787604230.867779:0:15520:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffffa09f81b85800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1787604230.867800:0:15520:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a084f11500 x1874438316597504/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787604230.867826:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787604230.867829:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787604230.867832:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787604230.867842:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787604230.867889:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3450:1874438316597376:0@lo:400:kworker.0 00000100:00100000:0.0:1787604230.867934:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604230.867995:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316597376 00000100:00100000:0.0:1787604230.868001:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316597376 00000100:00100000:0.0:1787604230.868034:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787604230.868042:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+12:3450:x1874438316597376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604230.868091:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+12:3450:x1874438316597376:12345-0@lo:400:kworker.0 Request processed in 50us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604230.868098:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787604230.868137:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3450:1874438316597376:0@lo:400:kworker.0 00000100:00100000:0.0:1787604230.868157:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316597504:0@lo:38:kworker.0 00000100:00100000:0.0:1787604230.868192:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604230.868227:0:21926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316597504 00000100:00100000:0.0:1787604230.868231:0:21926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316597504 00000100:00100000:0.0:1787604230.868262:0:21926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787604230.868268:0:21926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a084f10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3449:x1874438316597504:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787604230.868282:0:21926:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787604230.868322:0:21926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a084f10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3449:x1874438316597504:12345-0@lo:38:kworker.0 Request processed in 53us (129us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787604230.868330:0:21926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787604230.868358:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f81b85800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787604230.868363:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787604230.868367:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316597504:0@lo:38:kworker.0 00000100:00080000:0.0:1787604230.868396:0:21949:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787604230.868616:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787604230.868621:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787604230.868623:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787604230.868629:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787604230.873967:0:21949:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f11500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21949:1874438316597632:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787604230.874051:0:21949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604230.874102:0:21949:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08483af00 going to sleep for 11 seconds 00000100:00100000:0.0:1787604230.874130:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316597632 00000100:00100000:0.0:1787604230.874137:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316597632 00000100:00100000:0.0:1787604230.874181:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787604230.874191:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+12:21949:x1874438316597632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787604230.878823:0:21949:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f11500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21949:1874438316597632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787604230.878907:0:21949:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21949:1874438316597760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787604230.879028:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+12:21949:x1874438316597632:12345-0@lo:502:llog_process_th.0 Request processed in 4835us (4976us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604230.879041:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787604230.880933:0:21949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604230.880982:0:21949:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a083f459c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787604230.881386:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316597760 00000100:00100000:0.0:1787604230.881396:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316597760 00000100:00100000:0.0:1787604230.881453:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787604230.881463:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+12:21949:x1874438316597760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787604230.881717:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+12:21949:x1874438316597760:12345-0@lo:502:llog_process_th.0 Request processed in 254us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604230.881727:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787604230.881763:0:21949:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21949:1874438316597760:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787604230.881802:0:21949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787604230.882024:0:21902:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787604230.882050:0:21902:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787604230.882067:0:21902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa09f89d23e00/0x6c241a9cc41dd294 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd29b expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604230.882085:0:21902:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa09f89d23e00/0x6c241a9cc41dd294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd29b expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787604230.882129:0:21902:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787604230.882131:0:21902:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787604230.882132:0:21902:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787604230.882133:0:21902:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787604230.882134:0:21902:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787604230.882135:0:21902:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787604230.882137:0:21902:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787604230.882138:0:21902:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787604230.882140:0:21902:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787604230.882141:0:21902:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787604230.882144:0:21902:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787604230.882146:0:21902:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787604230.882147:0:21902:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787604230.882148:0:21902:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787604230.882149:0:21902:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787604230.882150:0:21902:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787604230.882151:0:21902:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787604230.882152:0:21902:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787604230.882153:0:21902:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787604230.882154:0:21902:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787604230.882155:0:21902:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787604230.882189:0:21902:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787604230.882205:0:21902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f11180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316597888:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787604230.882257:0:21902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604230.882282:0:21902:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08483a900 going to sleep for 11 seconds 00000100:00100000:0.0:1787604230.882305:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316597888 00000100:00100000:0.0:1787604230.882309:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316597888 00000100:00100000:0.0:1787604230.882336:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787604230.882343:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+12:21902:x1874438316597888:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787604230.882365:0:21915:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787604230.882386:0:21915:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787604230.949404:0:21915:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787604230.949421:0:21915:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787604230.949476:0:21936:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787604230.949481:0:21936:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787604230.949501:0:21936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604230.949520:0:21936:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0a0c207c000/0x6c241a9cc41dd27f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd278 expref: 12 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604230.949529:0:21936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604230.949567:0:21936:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0a0c207c000/0x6c241a9cc41dd27f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c241a9cc41dd278 expref: 12 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604230.949580:0:21936:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0a0c207c000/0x6c241a9cc41dd27f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c241a9cc41dd278 expref: 12 pid: 21915 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604230.949614:0:21936:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21936:1874438316598016:0@lo:104: 00000100:00100000:3.0:1787604230.949713:0:21936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604230.949755:0:21936:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a083f45d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787604230.950016:0:21903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316598016 00000100:00100000:2.0:1787604230.950023:0:21903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316598016 00000100:00100000:2.0:1787604230.950066:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787604230.950074:0:21903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a009c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+3:21936:x1874438316598016:12345-0@lo:104: 00010000:00010000:2.0:1787604230.950086:0:21903:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c241a9cc41dd27f expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604230.950141:0:21903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787604230.950147:0:21903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a009c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+3:21936:x1874438316598016:12345-0@lo:104: Request processed in 74us (436us total) trans 0 rc 0/0 00010000:00010000:1.0:1787604230.950151:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1787604230.950154:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787604230.950157:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c241a9cc41dd27f expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604230.950175:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09f89d22c00 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:1.0:1787604230.950179:0:21909:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c241a9cc41dd27f expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604230.950187:0:21909:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c241a9cc41dd27f expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787604230.950195:0:21909:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c241a9cc41dd27f expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787604230.950201:0:21909:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787604230.950238:0:21909:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd278 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd27f expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604230.950246:0:21909:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787604230.950269:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd278 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd27f expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604230.950276:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd278 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd27f expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604230.950291:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604230.950293:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604230.950295:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604230.950495:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3451:1874438316598144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787604230.950529:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604230.950576:0:21905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316598144 00000100:00100000:1.0:1787604230.950580:0:21905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316598144 00010000:00010000:1.0:1787604230.950598:0:21905:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0a0c207c000/0x6c241a9cc41dd27f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c241a9cc41dd278 expref: 13 pid: 21915 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604230.950743:0:21936:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21936:1874438316598016:0@lo:104: 00010000:00010000:3.0:1787604230.950762:0:21936:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604230.950823:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787604230.950833:0:21905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7271f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+13:3451:x1874438316598144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787604230.950844:0:21905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604230.950850:0:21905:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0a0c207c000/0x6c241a9cc41dd27f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c241a9cc41dd278 expref: 13 pid: 21915 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604230.950861:0:21905:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0a0c207c000/0x6c241a9cc41dd27f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c241a9cc41dd278 expref: 13 pid: 21915 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604230.950874:0:21905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0c207c000/0x6c241a9cc41dd27f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c241a9cc41dd278 expref: 13 pid: 21915 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604230.950888:0:21905:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604230.950895:0:21905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787604230.950906:0:21905:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001426270s 00010000:00010000:1.0:1787604230.950911:0:21905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604230.950917:0:21905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604230.950923:0:21905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604230.950929:0:21905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604230.950942:0:21905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0c207ca00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:1.0:1787604230.950946:0:21905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604230.950953:0:21905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604230.950973:0:21905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604230.950983:0:21905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787604230.951016:0:21905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7271f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+12:3451:x1874438316598144:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604230.951023:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787604230.951053:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3451:1874438316598144:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787604230.951167:0:21936:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604230.951175:0:21936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604230.951181:0:21936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604230.973354:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+11:21902:x1874438316597888:12345-0@lo:253:mount.lustre.0 Request processed in 90995us (91082us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604230.973369:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787604230.973723:0:21902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f11180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21902:1874438316597888:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787604230.973740:0:21902:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787604230.973743:0:21902:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787604230.973745:0:21902:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787604230.973746:0:21902:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787604230.973747:0:21902:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787604230.973749:0:21902:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787604230.973750:0:21902:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787604230.973751:0:21902:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787604230.973753:0:21902:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787604230.973755:0:21902:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787604230.973756:0:21902:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787604230.973771:0:21902:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787604230.983233:0:21902:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787604230.983419:0:21902:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787604230.987489:0:21902:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787604230.988885:0:21902:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787604230.989610:0:21902:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787604230.989825:0:21902:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787604230.991451:0:21902:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787604230.991619:0:21902:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787604230.991918:0:21902:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787604230.992135:0:21902:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787604230.992399:0:21902:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787604230.992560:0:21902:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1787604231.027872:0:21902:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:0.0:1787604231.028254:0:21902:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787604231.028315:0:21963:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:1.0:1787604231.028319:0:21963:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:01000000:1.0:1787604231.028567:0:21964:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1787604231.028641:0:21964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787604231.030643:0:21964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787604231.030762:0:21964:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:0.0:1787604231.030954:0:21902:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:0.0:1787604231.036679:0:21965:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffffa0a084f11880 x1874438316598272/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604231.036733:0:21965:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a091b7a600 going to sleep for 0 seconds 00000040:01000000:1.0:1787604231.040497:0:21902:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787604231.040627:0:21902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787604231.041237:0:21902:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787604231.041246:0:21902:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787604231.041386:0:21902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787604231.043028:0:21902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787604231.043928:0:21902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787604231.043975:0:21902:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787604231.044373:0:21902:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:1.0:1787604231.045342:0:21902:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:1.0:1787604231.050187:0:21902:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1787604231.092790:0:21902:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787604231.092837:0:21902:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb18e00c97988 00100000:10000000:1.0:1787604231.092846:0:21902:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787604231.094170:0:21902:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787604231.094185:0:21902:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.116@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787604231.094201:0:21902:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787604231.094224:0:21902:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1787604231.607209:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787604231.932140:0:21956:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787604231.932151:0:21956:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787604231.934531:0:21956:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787604231.934543:0:21956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787604232.055967:0:21965:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a091b7a600 going to sleep for 0 seconds 10000000:01000000:3.0:1787604232.438525:0:21917:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787604232.438536:0:21917:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0a0bc52f000 from 11 10000000:01000000:3.0:1787604232.438543:0:21917:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787604232.438614:0:21917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604232.439316:0:21917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604232.439333:0:21917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604232.439367:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316598400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787604232.439470:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604232.439533:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08538ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787604232.439630:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316598400 00000100:00100000:2.0:1787604232.439646:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316598400 00000100:00100000:2.0:1787604232.439744:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787604232.439755:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+11:21917:x1874438316598400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787604232.439772:0:21914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604232.439802:0:21914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a0bc44e200/0x6c241a9cc41dd2be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd2b7 expref: -99 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604232.439833:0:21914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a0bc44e200/0x6c241a9cc41dd2be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd2b7 expref: 12 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604232.439845:0:21914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a0bc44e200/0x6c241a9cc41dd2be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd2b7 expref: 12 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604232.439855:0:21914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a0bc44e200, rc 0) 00000100:00100000:2.0:1787604232.439900:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+12:21917:x1874438316598400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604232.439907:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787604232.440099:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316598400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787604232.440117:0:21917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd2be expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604232.440127:0:21917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd2be expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604232.440195:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316598528:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787604232.440231:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604232.440257:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08538ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787604232.440319:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316598528 00000100:00100000:2.0:1787604232.440325:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316598528 00000100:00100000:2.0:1787604232.440353:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787604232.440360:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+12:21917:x1874438316598528:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787604232.440376:0:21915:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787604232.440396:0:21915:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787604232.440399:0:21915:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1787604232.440501:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+12:21917:x1874438316598528:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604232.440509:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787604232.440732:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316598528:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787604232.441516:0:21917:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787604232.442001:0:21917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd2be expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604232.442022:0:21917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd2be expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604232.630143:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787604232.949986:0:21956:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787604232.950000:0:21956:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787604232.950523:0:21956:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1787604232.950592:0:21956:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787604232.950635:0:21956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:0.0:1787604233.078559:0:21965:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a091b7a600 going to sleep for 0 seconds 00010000:00010000:3.0:1787604233.658013:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604234.101820:0:21965:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a091b7a600 going to sleep for 0 seconds 00010000:00010000:0.0:1787604234.680935:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787604235.121326:0:22208:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787604235.125827:0:21965:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a091b7a600 going to sleep for 0 seconds 00010000:00010000:1.0:1787604235.707962:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604236.149784:0:21965:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a091b7a600 going to sleep for 0 seconds 00000100:00080000:0.0:1787604236.281036:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787604236.281042:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787604236.281046:0:37:0:(import.c:65:import_set_state_nolock()) ffffa09f81b85800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787604236.281054:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 611 00000100:00080000:0.0:1787604236.281059:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787604236.281067:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffffa09f81b85800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1787604236.281091:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a084f13480 x1874438316598784/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787604236.281103:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787604236.281106:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787604236.281109:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787604236.281112:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787604236.281115:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787604236.281118:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787604236.281119:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0a0bf091800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787604236.281124:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffffa0a0bf091800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1787604236.281134:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a084f12a00 x1874438316598912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787604236.281190:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316598784:0@lo:38:kworker.0 00000100:00100000:0.0:1787604236.281280:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604236.281330:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3449:1874438316598912:0@lo:38:kworker.0 00000100:00100000:0.0:1787604236.281358:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604236.281415:0:21926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316598784 00000100:00100000:0.0:1787604236.281423:0:21926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316598784 00000100:00100000:0.0:1787604236.281455:0:21926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787604236.281463:0:21926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a084f10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3449:x1874438316598784:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787604236.281481:0:21926:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787604236.281538:0:21926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a084f10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3449:x1874438316598784:12345-0@lo:38:kworker.0 Request processed in 74us (258us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787604236.281545:0:21926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787604236.281575:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316598912 00000100:00100000:0.0:1787604236.281579:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316598912 00000100:00100000:0.0:1787604236.284384:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787604236.284394:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a084f11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3449:x1874438316598912:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787604236.284423:0:21922:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 616 last 0 00000020:00000080:0.0:1787604236.284462:0:21922:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x6c241a9cc41dd2c5 00000004:00100000:0.0:1787604236.284478:0:21922:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787604236.284850:0:21922:0:(import.c:65:import_set_state_nolock()) ffffa0a08373d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787604236.284926:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a084f11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3449:x1874438316598912:12345-0@lo:38:kworker.0 Request processed in 531us (3567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604236.284934:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787604236.284988:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f81b85800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787604236.284994:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787604236.284998:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316598784:0@lo:38:kworker.0 00010000:00080000:0.0:1787604236.285014:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0a084f12a00 x1874438316598912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787604246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787604236.285028:0:3449:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1787604236.285036:0:3449:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787604236.285054:0:3449:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787604236.285057:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa0a0bf091800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787604236.285063:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3449:1874438316598912:0@lo:38:kworker.0 00000100:00100000:2.0:1787604236.287052:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787604236.287074:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3453:1874438316598656:0@lo:400:kworker.0 00000100:00100000:2.0:1787604236.287152:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604236.287220:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316598656 00000100:00100000:2.0:1787604236.287227:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316598656 00000100:00100000:2.0:1787604236.287270:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787604236.287279:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+12:3453:x1874438316598656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604236.287326:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+12:3453:x1874438316598656:12345-0@lo:400:kworker.0 Request processed in 48us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604236.287333:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787604236.287377:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3453:1874438316598656:0@lo:400:kworker.0 00010000:00010000:3.0:1787604236.727021:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604237.185718:0:21965:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a091b7a600 going to sleep for 0 seconds 00010000:00010000:1.0:1787604237.751562:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604238.197864:0:21965:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a091b7a600 going to sleep for 0 seconds 00010000:00010000:0.0:1787604238.774244:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604239.227177:0:21965:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a091b7a600 going to sleep for 0 seconds 00010000:00010000:1.0:1787604239.800270:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604240.247163:0:21965:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a091b7a600 going to sleep for 0 seconds 00000100:00100000:1.0:1787604240.375034:0:3449:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787604230/real 1787604230] req@ffffa0a0b7270700 x1874438316595584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787604240 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604240.375156:0:3449:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0a0b7270700 x1874438316595584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787604240 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604240.375168:0:3449:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787604230/real 1787604230] req@ffffa0a0a009e680 x1874438316595456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787604240 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604240.375189:0:3449:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0a0a009e680 x1874438316595456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787604240 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787604240.375208:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa0a0bca77000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787604240.375231:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787604240.375236:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316595584:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787604240.375241:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f884b0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787604240.375247:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787604240.375250:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316595456:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787604240.375750:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787604240.375755:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787604240.375758:0:37:0:(import.c:65:import_set_state_nolock()) ffffa09f81b85800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787604240.375764:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 616 00000100:00080000:3.0:1787604240.375775:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787604240.375781:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffffa09f81b85800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1787604240.375802:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a0a009dc00 x1874438316599168/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787604240.376461:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3453:1874438316599040:0@lo:400:kworker.0 00000100:00100000:1.0:1787604240.376527:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787604240.376717:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787604240.376721:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787604240.376723:0:37:0:(import.c:65:import_set_state_nolock()) ffffa09f884b0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787604240.376727:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 610 00000100:00080000:3.0:1787604240.376730:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787604240.376735:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa09f884b0000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1787604240.376765:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a0a009f800 x1874438316599296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787604240.376774:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787604240.376777:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787604240.376778:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0a0bca77000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787604240.376781:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 610 00000100:00080000:3.0:1787604240.376783:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787604240.376786:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0a0bca77000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1787604240.376795:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a0a009df80 x1874438316599424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787604240.378857:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316599040 00000100:00100000:3.0:1787604240.378870:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316599040 00000100:00100000:3.0:1787604240.378918:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787604240.378928:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+12:3453:x1874438316599040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604240.379011:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+12:3453:x1874438316599040:12345-0@lo:400:kworker.0 Request processed in 84us (2483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604240.379040:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787604240.379088:0:3451:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787604240.379100:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3451:1874438316599552:0@lo:400:kworker.0 00000100:00100000:3.0:1787604240.379138:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604240.379186:0:21921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316599552 00000100:00100000:3.0:1787604240.379190:0:21921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316599552 00000100:00100000:3.0:1787604240.379215:0:21921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787604240.379222:0:21921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a009fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3451:x1874438316599552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604240.379272:0:21921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a009fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3451:x1874438316599552:12345-0@lo:400:kworker.0 Request processed in 50us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604240.379278:0:21921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787604240.379315:0:3451:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0a0a009c380 x1874438316599552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604240.379327:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3451:1874438316599552:0@lo:400:kworker.0 00000100:00100000:3.0:1787604240.379353:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3453:1874438316599040:0@lo:400:kworker.0 00000100:00100000:1.0:1787604240.387626:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316599168:0@lo:38:kworker.0 00000100:00100000:1.0:1787604240.387714:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604240.387760:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316599296:0@lo:8:kworker.0 00000400:00000100:1.0:1787604240.387783:0:3449:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874438316599296 offset 0 length 520: 4 00000100:00100000:1.0:1787604240.387820:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316599424:0@lo:8:kworker.0 00000400:00000100:1.0:1787604240.387840:0:3449:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874438316599424 offset 0 length 520: 4 00000100:00100000:1.0:1787604240.387886:0:21926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316599168 00000100:00100000:1.0:1787604240.387894:0:21926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316599168 00000100:00100000:1.0:1787604240.387930:0:21926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787604240.387937:0:21926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3449:x1874438316599168:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787604240.387954:0:21926:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787604240.387996:0:21926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3449:x1874438316599168:12345-0@lo:38:kworker.0 Request processed in 58us (280us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787604240.388010:0:21926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787604240.388053:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f81b85800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787604240.388421:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787604240.388426:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316599168:0@lo:38:kworker.0 00010000:00010000:3.0:1787604240.822193:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604241.271868:0:21965:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a091b7a600 going to sleep for 0 seconds 00010000:00010000:1.0:1787604241.846021:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787604242.166476:0:21956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787604242.293840:0:21965:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a091b7a600 going to sleep for 0 seconds 00000020:01000004:2.0:1787604242.440363:0:22559:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787604242.440367:0:22559:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt2/mdt2 00000080:01200004:2.0:1787604242.440474:0:22559:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa09f891cd000 00000020:01000004:2.0:1787604242.440489:0:22559:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-zfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1787604242.440787:0:22559:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787604242.440802:0:22559:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffffa0a086230000) 00000020:00000080:2.0:1787604242.440819:0:22559:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787604242.463324:0:22559:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787604242.463591:0:22559:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787604242.465895:0:22559:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0001: registered index [0x200000003:0x30:0x0] (8/32) 00100000:10000000:3.0:1787604242.467941:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lustre-client under 134: rc = 0 00100000:10000000:3.0:1787604242.468207:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lustre-MDT0001 under 134: rc = 0 00100000:10000000:3.0:1787604242.468308:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled params under 134: rc = 0 00100000:10000000:3.0:1787604242.469091:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x10000 under 153: rc = 0 00100000:10000000:3.0:1787604242.469449:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x20000-MDT0001 under 153: rc = 0 00100000:10000000:3.0:1787604242.469766:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2020000-MDT0001 under 153: rc = 0 00100000:10000000:3.0:1787604242.470045:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2020000 under 153: rc = 0 00100000:10000000:3.0:1787604242.470309:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1020000 under 153: rc = 0 00100000:10000000:3.0:1787604242.471915:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1010000-MDT0001 under 153: rc = 0 00100000:10000000:3.0:1787604242.472332:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1020000-MDT0001 under 153: rc = 0 00100000:10000000:3.0:1787604242.472615:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1010000 under 153: rc = 0 00100000:10000000:3.0:1787604242.473304:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2010000 under 153: rc = 0 00100000:10000000:3.0:1787604242.473570:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x20000 under 153: rc = 0 00100000:10000000:3.0:1787604242.473893:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x10000-MDT0001 under 153: rc = 0 00100000:10000000:3.0:1787604242.474346:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2010000-MDT0001 under 153: rc = 0 00100000:10000000:3.0:1787604242.475905:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_00 under 166: rc = 0 00100000:10000000:3.0:1787604242.476309:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_10 under 166: rc = 0 00100000:10000000:3.0:1787604242.476585:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_13 under 166: rc = 0 00100000:10000000:3.0:1787604242.476891:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_09 under 166: rc = 0 00100000:10000000:3.0:1787604242.477535:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_03 under 166: rc = 0 00100000:10000000:3.0:1787604242.477850:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_04 under 166: rc = 0 00100000:10000000:3.0:1787604242.478568:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_14 under 166: rc = 0 00100000:10000000:3.0:1787604242.480420:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_07 under 166: rc = 0 00100000:10000000:3.0:1787604242.482270:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_13 under 166: rc = 0 00100000:10000000:3.0:1787604242.482566:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_03 under 166: rc = 0 00100000:10000000:3.0:1787604242.482920:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_09 under 166: rc = 0 00100000:10000000:3.0:1787604242.485666:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_00 under 166: rc = 0 00100000:10000000:3.0:1787604242.486036:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_10 under 166: rc = 0 00100000:10000000:3.0:1787604242.486556:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_07 under 166: rc = 0 00100000:10000000:2.0:1787604242.488482:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_04 under 166: rc = 0 00100000:10000000:2.0:1787604242.488901:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_14 under 166: rc = 0 00100000:10000000:2.0:1787604242.490135:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_06 under 166: rc = 0 00100000:10000000:2.0:1787604242.490371:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_05 under 166: rc = 0 00100000:10000000:2.0:1787604242.490929:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_15 under 166: rc = 0 00100000:10000000:2.0:1787604242.491339:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_12 under 166: rc = 0 00100000:10000000:2.0:1787604242.496462:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_02 under 166: rc = 0 00100000:10000000:2.0:1787604242.503919:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_08 under 166: rc = 0 00100000:10000000:2.0:1787604242.504570:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_01 under 166: rc = 0 00100000:10000000:2.0:1787604242.507384:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_11 under 166: rc = 0 00100000:10000000:2.0:1787604242.507645:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_05 under 166: rc = 0 00100000:10000000:2.0:1787604242.507943:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_15 under 166: rc = 0 00100000:10000000:2.0:1787604242.508175:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_06 under 166: rc = 0 00100000:10000000:2.0:1787604242.508413:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_01 under 166: rc = 0 00100000:10000000:2.0:1787604242.508679:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_11 under 166: rc = 0 00100000:10000000:2.0:1787604242.514079:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_12 under 166: rc = 0 00100000:10000000:2.0:1787604242.514378:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_08 under 166: rc = 0 00100000:10000000:2.0:1787604242.515093:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_02 under 166: rc = 0 00100000:10000000:2.0:1787604242.517038:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled [0x240000400:0x1:0x0] under 644: rc = 0 00100000:10000000:2.0:1787604242.517303:0:22559:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled [0x240000401:0x1:0x0] under 644: rc = 0 00000020:00000080:2.0:1787604242.521387:0:22559:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1787604242.521399:0:22559:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787604242.521409:0:22559:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6c241a9cc41dd2d3 00000020:01000004:2.0:1787604242.521417:0:22559:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device lustre-mdt2/mdt2 00000020:01000004:2.0:1787604242.521437:0:22559:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.116@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787604242.521441:0:22559:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787604242.521447:0:22559:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1787604242.521481:0:22559:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt2/mdt2 10000000:01000000:2.0:1787604242.521485:0:22559:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.116@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1787604242.542759:0:22559:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.116@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787604242.542796:0:22559:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.116@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1787604242.542800:0:22559:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787604242.542802:0:22559:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787604242.542803:0:22559:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787604242.542805:0:22559:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787604242.542806:0:22559:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787604242.542807:0:22559:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787604242.542808:0:22559:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787604242.542810:0:22559:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787604242.542811:0:22559:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787604242.542815:0:22559:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1787604242.542817:0:22559:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787604242.542819:0:22559:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787604242.542820:0:22559:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787604242.542821:0:22559:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787604242.542822:0:22559:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787604242.542823:0:22559:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787604242.542824:0:22559:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787604242.542826:0:22559:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787604242.542827:0:22559:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787604242.542852:0:22559:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787604242.542872:0:22559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f12a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316599680:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787604242.542950:0:22559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604242.543077:0:22559:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08898b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787604242.544149:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316599680 00000100:00100000:2.0:1787604242.544159:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316599680 00000100:00100000:0.0:1787604242.544342:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787604242.544354:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+12:22559:x1874438316599680:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787604242.544385:0:21915:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787604242.544389:0:21915:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1787604242.544405:0:21915:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1787604242.572058:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+12:22559:x1874438316599680:12345-0@lo:253:mount.lustre.0 Request processed in 27695us (29097us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604242.572073:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787604242.572171:0:22559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f12a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316599680:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787604242.572188:0:22559:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787604242.572192:0:22559:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787604242.572194:0:22559:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787604242.572195:0:22559:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787604242.572209:0:22559:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787604242.572210:0:22559:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787604242.572212:0:22559:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787604242.572213:0:22559:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787604242.572215:0:22559:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787604242.572216:0:22559:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787604242.572234:0:22559:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa09f891cd000 from lustre-MDT0001 10000000:01000000:2.0:1787604242.572259:0:22559:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1787604242.572262:0:22559:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787604242.572274:0:22559:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa0a0906a3370 local copy 00010000:00010000:2.0:1787604242.572286:0:22559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa09f89d23a00/0x6c241a9cc41dd1c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd1d0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604242.572511:0:22559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316599808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787604242.572547:0:22559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604242.572890:0:22559:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a085489900 going to sleep for 11 seconds 00000100:00100000:3.0:1787604242.573171:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316599808 00000100:00100000:3.0:1787604242.573178:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316599808 00000100:00100000:3.0:1787604242.573227:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787604242.573236:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+12:22559:x1874438316599808:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787604242.575457:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+12:22559:x1874438316599808:12345-0@lo:501:mount.lustre.0 Request processed in 2213us (2901us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787604242.575471:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787604242.575851:0:22559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316599808:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787604242.575879:0:22559:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787604242.577929:0:22559:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787604242.577942:0:22559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa09f89d23a00/0x6c241a9cc41dd1c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd1d0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.577954:0:22559:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa09f89d23a00/0x6c241a9cc41dd1c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd1d0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604242.577978:0:22559:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa09f891cd000 10000000:01000000:2.0:1787604242.577983:0:22559:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787604242.577989:0:22559:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffffa0a0906a3370 10000000:01000000:2.0:1787604242.577991:0:22559:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787604242.577994:0:22559:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffffa0a0906a3370 from 1 10000000:01000000:2.0:1787604242.577997:0:22559:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787604242.578038:0:22559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e400/0x6c241a9cc41dd2da lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.578046:0:22559:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e400/0x6c241a9cc41dd2da lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.578130:0:22559:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e400/0x6c241a9cc41dd2da lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604242.578157:0:22559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316599936:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787604242.578220:0:22559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604242.578326:0:22559:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a085489900 going to sleep for 11 seconds 00000100:00100000:0.0:1787604242.578506:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316599936 00000100:00100000:0.0:1787604242.578513:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316599936 00000100:00100000:0.0:1787604242.579049:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787604242.579177:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+12:22559:x1874438316599936:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787604242.579190:0:21915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604242.579205:0:21915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09f89d22400/0x6c241a9cc41dd2e1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd2da expref: -99 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604242.579228:0:21915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09f89d22400/0x6c241a9cc41dd2e1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd2da expref: 13 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604242.579238:0:21915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09f89d22400/0x6c241a9cc41dd2e1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd2da expref: 13 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604242.579247:0:21915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09f89d22400, rc 0) 00000100:00100000:0.0:1787604242.579374:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+13:22559:x1874438316599936:12345-0@lo:101:mount.lustre.0 Request processed in 202us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604242.579381:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787604242.579470:0:22559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316599936:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787604242.579485:0:22559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e400/0x6c241a9cc41dd2da lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd2e1 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.579494:0:22559:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e400/0x6c241a9cc41dd2da lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd2e1 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604242.579514:0:22559:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787604242.579531:0:22559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e400/0x6c241a9cc41dd2da lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd2e1 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.579538:0:22559:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e400/0x6c241a9cc41dd2da lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd2e1 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604242.580472:0:22559:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffffa09f891cd000 10000000:01000000:2.0:1787604242.580483:0:22559:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787604242.580488:0:22559:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffffa09f891cd000 from 1 10000000:01000000:2.0:1787604242.580505:0:22559:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787604242.580535:0:22559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f200/0x6c241a9cc41dd2e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.580544:0:22559:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f200/0x6c241a9cc41dd2e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.580566:0:22559:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f200/0x6c241a9cc41dd2e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604242.580585:0:22559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316600064:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787604242.580642:0:22559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604242.581928:0:22559:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a085489900 going to sleep for 11 seconds 00000100:00100000:3.0:1787604242.582006:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316600064 00000100:00100000:3.0:1787604242.582013:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316600064 00000100:00100000:3.0:1787604242.582139:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787604242.582150:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a04cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+13:22559:x1874438316600064:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787604242.582164:0:21914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604242.582180:0:21914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a0c207c200/0x6c241a9cc41dd2ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd2e8 expref: -99 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604242.582204:0:21914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a0c207c200/0x6c241a9cc41dd2ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd2e8 expref: 14 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604242.582213:0:21914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a0c207c200/0x6c241a9cc41dd2ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd2e8 expref: 14 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604242.582221:0:21914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a0c207c200, rc 0) 00000100:00100000:3.0:1787604242.582289:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a04cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+14:22559:x1874438316600064:12345-0@lo:101:mount.lustre.0 Request processed in 141us (1646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604242.582296:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787604242.582397:0:22559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316600064:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787604242.582412:0:22559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f200/0x6c241a9cc41dd2e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd2ef expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.582421:0:22559:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f200/0x6c241a9cc41dd2e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd2ef expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604242.582438:0:22559:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787604242.582457:0:22559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f200/0x6c241a9cc41dd2e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd2ef expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.582465:0:22559:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f200/0x6c241a9cc41dd2e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd2ef expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604242.582472:0:22559:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787604242.582477:0:22559:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787604242.582494:0:22559:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffffa09f891cd000 10000000:01000000:2.0:1787604242.582497:0:22559:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787604242.582501:0:22559:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1787604242.582504:0:22559:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787604242.582525:0:22559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44fe00/0x6c241a9cc41dd2f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.582532:0:22559:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44fe00/0x6c241a9cc41dd2f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.582540:0:22559:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44fe00/0x6c241a9cc41dd2f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604242.582568:0:22559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316600192:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787604242.582605:0:22559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604242.582635:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316600192 00000100:00100000:2.0:1787604242.582640:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316600192 00000100:00100000:2.0:1787604242.582658:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787604242.582664:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a04ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+14:22559:x1874438316600192:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787604242.582671:0:21914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604242.582679:0:21914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a0bc44f800/0x6c241a9cc41dd2fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd2f6 expref: -99 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.582715:0:21914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a0bc44f800/0x6c241a9cc41dd2fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd2f6 expref: 15 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.582733:0:21914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a0bc44f800/0x6c241a9cc41dd2fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd2f6 expref: 15 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.582740:0:21914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a0bc44f800, rc 0) 00000100:00100000:2.0:1787604242.582771:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a04ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+15:22559:x1874438316600192:12345-0@lo:101:mount.lustre.0 Request processed in 107us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604242.582777:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787604242.582806:0:22559:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a085489900 going to sleep for 11 seconds 00000100:00100000:2.0:1787604242.582818:0:22559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316600192:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787604242.582828:0:22559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44fe00/0x6c241a9cc41dd2f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd2fd expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.582835:0:22559:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44fe00/0x6c241a9cc41dd2f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd2fd expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787604242.583841:0:22559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1787604242.584938:0:22559:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787604242.585184:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1787604242.585223:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1787604242.585259:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1787604242.585287:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1787604242.585312:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1787604242.585346:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1787604242.585373:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1787604242.585397:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1787604242.585433:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1787604242.585460:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1787604242.585857:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1787604242.585905:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1787604242.585934:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1787604242.585959:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1787604242.585993:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1787604242.586020:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1787604242.586044:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 160 off11176 00000040:00080000:2.0:1787604242.586196:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11400 00000040:00080000:2.0:1787604242.586237:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11624 00000040:00080000:2.0:1787604242.586319:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 80 off11704 00000040:00080000:2.0:1787604242.586369:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1787604242.586397:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1787604242.586422:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1787604242.586457:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1787604242.586484:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1787604242.586508:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1787604242.586573:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1787604242.586604:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1787604242.586635:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1787604242.586826:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1787604242.586870:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1787604242.586908:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1787604242.586961:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1787604242.586997:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1787604242.587031:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1787604242.587665:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1787604242.587768:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1787604242.587806:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1787604242.587862:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1787604242.587901:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1787604242.587934:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1787604242.587989:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1787604242.588044:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1787604242.588080:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1787604242.588198:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1787604242.588207:0:22559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1787604242.588306:0:22559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316600320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787604242.588375:0:22559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604242.588426:0:22559:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0854893c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787604242.588601:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316600320 00000100:00100000:3.0:1787604242.588610:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316600320 00000100:00100000:3.0:1787604242.588658:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787604242.588668:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a04ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+15:22559:x1874438316600320:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787604242.589085:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a04ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+15:22559:x1874438316600320:12345-0@lo:501:mount.lustre.0 Request processed in 418us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604242.589101:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787604242.589256:0:22559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316600320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787604242.589296:0:22559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316600448:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787604242.589336:0:22559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604242.589405:0:22559:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0854893c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787604242.589441:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316600448 00000100:00100000:1.0:1787604242.589446:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316600448 00000100:00100000:1.0:1787604242.589549:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787604242.589558:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a04cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+15:22559:x1874438316600448:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787604242.590125:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a04cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+15:22559:x1874438316600448:12345-0@lo:503:mount.lustre.0 Request processed in 568us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604242.590133:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787604242.590202:0:22559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316600448:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787604242.592143:0:22559:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787604242.592230:0:22559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316600576:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787604242.592305:0:22559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604242.592399:0:22559:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0854893c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787604242.596201:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316600576 00000100:00100000:1.0:1787604242.596216:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316600576 00000100:00100000:1.0:1787604242.596354:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787604242.596367:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a08af2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+15:22559:x1874438316600576:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787604242.596925:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a08af2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+15:22559:x1874438316600576:12345-0@lo:502:mount.lustre.0 Request processed in 560us (4618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604242.596933:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787604242.597212:0:22559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316600576:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787604242.598085:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1787604242.598163:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:2.0:1787604242.598223:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:2.0:1787604242.598265:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:2.0:1787604242.598300:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:2.0:1787604242.598350:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:2.0:1787604242.598390:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:2.0:1787604242.598766:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:2.0:1787604242.598820:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:2.0:1787604242.598865:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:2.0:1787604242.598924:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:2.0:1787604242.598973:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:2.0:1787604242.599009:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:2.0:1787604242.599046:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:2.0:1787604242.599095:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:2.0:1787604242.599132:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:2.0:1787604242.599168:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 160 off11176 00000040:00080000:2.0:1787604242.599216:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11400 00000040:00080000:2.0:1787604242.599252:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11624 00000040:00080000:2.0:1787604242.599299:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 80 off11704 00000040:00080000:2.0:1787604242.599351:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:2.0:1787604242.599386:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:2.0:1787604242.599638:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:2.0:1787604242.599809:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:2.0:1787604242.599852:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:2.0:1787604242.599889:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:2.0:1787604242.599970:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:2.0:1787604242.600011:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:2.0:1787604242.600045:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:2.0:1787604242.600096:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:2.0:1787604242.600133:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:2.0:1787604242.600166:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:2.0:1787604242.600213:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:2.0:1787604242.600250:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:2.0:1787604242.600285:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:2.0:1787604242.600326:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:2.0:1787604242.602180:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:2.0:1787604242.602247:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:2.0:1787604242.602319:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:2.0:1787604242.602359:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:2.0:1787604242.602396:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:2.0:1787604242.602450:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:2.0:1787604242.602526:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:2.0:1787604242.602653:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:2.0:1787604242.602804:0:22559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316600704:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787604242.602888:0:22559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604242.602930:0:22559:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0854893c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787604242.603034:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316600704 00000100:00100000:1.0:1787604242.603042:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316600704 00000100:00100000:1.0:1787604242.603093:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787604242.603102:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a08af2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+15:22559:x1874438316600704:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787604242.603318:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a08af2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+15:22559:x1874438316600704:12345-0@lo:502:mount.lustre.0 Request processed in 216us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604242.603336:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787604242.603443:0:22559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316600704:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787604242.603676:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1787604242.603737:0:22559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1787604242.605101:0:22560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787604242.605114:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604242.605116:0:22560:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787604242.605122:0:22560:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1787604242.605124:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787604242.605139:0:22560:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffffa0a086234d28) 00000020:00000080:2.0:1787604242.605161:0:22560:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1787604242.605167:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787604242.605231:0:22560:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787604242.605239:0:22560:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6c241a9cc41dd30b 00000020:00000080:2.0:1787604242.605456:0:22560:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1787604242.605868:0:22560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787604242.605872:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604242.605874:0:22560:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787604242.605877:0:22560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787604242.605882:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604242.605883:0:22560:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1787604242.605886:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787604242.605896:0:22560:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffffa09f82080000) 00000020:00000080:2.0:1787604242.605909:0:22560:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1787604242.605913:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787604242.605915:0:22560:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1787604242.605918:0:22560:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1787604242.605924:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787604242.605989:0:22560:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa09f891cd000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1787604242.606003:0:22560:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffffa09f82084d28) 00000020:00000080:2.0:1787604242.606012:0:22560:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1787604242.606063:0:22560:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787604242.606069:0:22560:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6c241a9cc41dd320 00000020:00000080:2.0:1787604242.606169:0:22560:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1787604242.606177:0:22560:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787604242.606182:0:22560:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x6c241a9cc41dd327 00080000:01000000:2.0:1787604242.606187:0:22560:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787604242.606198:0:22560:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6c241a9cc41dd32e 00010000:00010000:2.0:1787604242.719050:0:22560:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1787604242.719638:0:22560:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1787604242.719858:0:22560:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787604242.726792:0:22560:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1787604242.726806:0:22560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787604242.726812:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604242.726814:0:22560:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1787604242.726819:0:22560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787604242.726824:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604242.726825:0:22560:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1787604242.726828:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787604242.726833:0:22560:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.116@tcp to nid 0x20000c0a8cb74 (192.168.203.116@tcp) 00000020:00000080:2.0:1787604242.726860:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787604242.726874:0:22560:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffffa09f82083370) 00000020:00000080:2.0:1787604242.726894:0:22560:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1787604242.726898:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787604242.727862:0:22560:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1787604242.727874:0:22560:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787604242.727883:0:22560:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6c241a9cc41dd33c 00010000:00080000:2.0:1787604242.727922:0:22560:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0a0bc134000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.116@tcp at head 00010000:00010000:2.0:1787604242.736807:0:22560:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1787604242.743033:0:22560:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787604242.743050:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787604242.743087:0:22560:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787604242.743109:0:22560:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6c241a9cc41dd343 00000100:00080000:1.0:1787604242.743119:0:22560:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787604242.743125:0:22560:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffffa0a0bc134000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1787604242.743163:0:22560:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a0b7271180 x1874438316600832/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787604242.743199:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3449:1874438316600832:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787604242.743268:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604242.743605:0:21926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316600832 00000100:00100000:1.0:1787604242.743613:0:21926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316600832 00000100:00100000:1.0:1787604242.743648:0:21926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787604242.743655:0:21926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3449:x1874438316600832:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787604242.743717:0:21926:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 622 last 0 00000020:00000080:1.0:1787604242.743760:0:21926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6c241a9cc41dd34a 00000004:00100000:1.0:1787604242.743777:0:21926:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1787604242.743781:0:21926:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:1.0:1787604242.743931:0:22560:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787604242.743955:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787604242.743959:0:15520:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787604242.743962:0:15520:0:(import.c:65:import_set_state_nolock()) ffffa09f81b85800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787604242.743967:0:15520:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 620 00000100:00080000:1.0:1787604242.743969:0:15520:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787604242.743980:0:15520:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffffa09f81b85800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1787604242.743998:0:15520:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a0b7273100 x1874438316600960/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787604242.744013:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787604242.744017:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787604242.744020:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787604242.744022:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787604242.744059:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787604242.744068:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7273b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3450:1874438316601088:0@lo:400:kworker.0 00000100:00100000:1.0:1787604242.744106:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604242.744147:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316601088 00000100:00100000:1.0:1787604242.744151:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316601088 00000100:00100000:1.0:1787604242.744179:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787604242.744185:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1874438316601088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604242.744228:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1874438316601088:12345-0@lo:400:kworker.0 Request processed in 42us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604242.744234:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787604242.744265:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0a0b7273b80 x1874438316601088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604242.744277:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7273b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3450:1874438316601088:0@lo:400:kworker.0 00000100:00100000:1.0:1787604242.744295:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7273100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316600960:0@lo:38:kworker.0 00000100:00100000:1.0:1787604242.744318:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604242.744344:0:21925:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1787604242.744351:0:21925:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000020:01000000:1.0:1787604242.747606:0:22560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787604242.747614:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604242.747616:0:22560:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1787604242.747619:0:22560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787604242.747625:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604242.747627:0:22560:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1787604242.747630:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787604242.747675:0:22560:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787604242.747708:0:22560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787604242.747711:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604242.747713:0:22560:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1787604242.747715:0:22560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787604242.747717:0:22560:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1787604242.747719:0:22560:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787604242.747720:0:22560:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787604242.747732:0:22560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787604242.747735:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604242.747736:0:22560:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787604242.747739:0:22560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787604242.747740:0:22560:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1787604242.747741:0:22560:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787604242.747743:0:22560:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787604242.747744:0:22560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787604242.747746:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604242.747747:0:22560:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787604242.747749:0:22560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787604242.747753:0:22560:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt2/mdt2 00000020:00000080:1.0:1787604242.747755:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604242.747756:0:22560:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787604242.747759:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787604242.747762:0:22560:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.116@tcp to nid 0x20000c0a8cb74 (192.168.203.116@tcp) 00000020:01000000:1.0:1787604242.747785:0:22560:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787604242.747788:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787604242.747803:0:22560:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffffa0a0916d0000) 00000020:00000080:1.0:1787604242.747827:0:22560:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1787604242.747833:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787604242.747895:0:22560:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1787604242.747901:0:22560:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787604242.747908:0:22560:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6c241a9cc41dd358 00010000:00080000:1.0:1787604242.747940:0:22560:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa09f891cb000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.116@tcp at head 00010000:00010000:1.0:1787604242.748167:0:22560:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:1.0:1787604242.748616:0:22560:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787604242.748663:0:22560:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1787604242.756038:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316600960 00000100:00100000:0.0:1787604242.756051:0:21925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316600960 00000100:00100000:0.0:1787604242.756176:0:22565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787604242.756184:0:22565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3449:x1874438316600960:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787604242.756457:0:22565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3449:x1874438316600960:12345-0@lo:38:kworker.0 Request processed in 270us (12136us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787604242.756465:0:22565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787604242.756680:0:3449:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787604242.756709:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f81b85800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787604242.756713:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787604242.756717:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7273100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316600960:0@lo:38:kworker.0 00000040:00080000:1.0:1787604242.757157:0:22560:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787604242.757227:0:22560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1787604242.757291:0:22560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1787604242.764185:0:22566:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787604242.764193:0:22566:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787604242.771992:0:22560:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787604242.772008:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787604242.772049:0:22560:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787604242.772075:0:22560:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6c241a9cc41dd35f 00000100:00080000:1.0:1787604242.772086:0:22560:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787604242.772092:0:22560:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffffa09f891cb000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1787604242.772128:0:22560:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a0b7273480 x1874438316601216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787604242.772151:0:22560:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1787604242.772200:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3449:1874438316601216:0@lo:8:llog_process_th.0 00000020:01000000:1.0:1787604242.772210:0:22560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787604242.772214:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604242.772215:0:22560:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787604242.772218:0:22560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787604242.772220:0:22560:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1787604242.772221:0:22560:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787604242.772223:0:22560:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787604242.772224:0:22560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787604242.772226:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604242.772227:0:22560:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787604242.772238:0:22560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787604242.772242:0:22560:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt2/mdt2 00000020:00000080:1.0:1787604242.772244:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604242.772246:0:22560:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787604242.772248:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787604242.772251:0:22560:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.116@tcp to nid 0x20000c0a8cb74 (192.168.203.116@tcp) 00000400:00000100:0.0:1787604242.772254:0:3449:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874438316601216 offset 0 length 520: 4 00000020:01000000:1.0:1787604242.772270:0:22560:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787604242.772272:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787604242.772297:0:22560:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffffa09f89e50000) 00000020:00000080:1.0:1787604242.772311:0:22560:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1787604242.772317:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787604242.772376:0:22560:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1787604242.772382:0:22560:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000100:00080000:3.0:1787604242.772391:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:00000080:1.0:1787604242.772393:0:22560:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6c241a9cc41dd36d 00000100:00080000:3.0:1787604242.772395:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787604242.772398:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787604242.772401:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:1.0:1787604242.772424:0:22560:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa09f889a1000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.116@tcp at head 00010000:00010000:1.0:1787604242.772766:0:22560:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1787604242.772935:0:22560:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787604242.772957:0:22560:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787604242.773430:0:22560:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787604242.773494:0:22560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1787604242.776555:0:22560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1787604242.777123:0:22569:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787604242.777128:0:22569:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787604242.779408:0:22560:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787604242.779423:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787604242.779462:0:22560:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787604242.779485:0:22560:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6c241a9cc41dd374 00000100:00080000:0.0:1787604242.779496:0:22560:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787604242.780122:0:22560:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffffa09f889a1000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1787604242.780412:0:22560:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a084f13480 x1874438316601344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787604242.780449:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3449:1874438316601344:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787604242.780514:0:3449:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874438316601344 offset 0 length 520: 4 00000100:00080000:0.0:1787604242.780568:0:22560:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787604242.783270:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787604242.783281:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787604242.783284:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787604242.783287:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1787604242.783904:0:22560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787604242.783912:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787604242.783914:0:22560:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787604242.783918:0:22560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787604242.783921:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787604242.783923:0:22560:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787604242.783926:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787604242.783928:0:22560:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787604242.783931:0:22560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787604242.783933:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787604242.783934:0:22560:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787604242.783945:0:22560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787604242.783947:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787604242.783948:0:22560:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787604242.783952:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787604242.784318:0:22560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787604242.784323:0:22560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787604242.784325:0:22560:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787604242.784328:0:22560:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:3.0:1787604242.785183:0:22559:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1787604242.785324:0:22559:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787604242.785340:0:22559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44fe00/0x6c241a9cc41dd2f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd2fd expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604242.785352:0:22559:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44fe00/0x6c241a9cc41dd2f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd2fd expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604242.785448:0:22559:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa09f891cd000 from 1 10000000:01000000:2.0:1787604242.785452:0:22559:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787604242.785489:0:22559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ea00/0x6c241a9cc41dd37b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.785562:0:22559:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ea00/0x6c241a9cc41dd37b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.785659:0:22559:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ea00/0x6c241a9cc41dd37b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604242.785816:0:22559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316601472:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787604242.785884:0:22559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604242.786631:0:22559:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a082fffc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787604242.786879:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316601472 00000100:00100000:3.0:1787604242.786888:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316601472 00000100:00100000:2.0:1787604242.787127:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787604242.787137:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a08af2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+15:22559:x1874438316601472:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787604242.787152:0:21913:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604242.787168:0:21913:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a0bc44ec00/0x6c241a9cc41dd382 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd37b expref: -99 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.787263:0:21913:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a0bc44ec00/0x6c241a9cc41dd382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd37b expref: 16 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.787276:0:21913:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a0bc44ec00/0x6c241a9cc41dd382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd37b expref: 16 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.787284:0:21913:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a0bc44ec00, rc 0) 00000100:00100000:2.0:1787604242.787337:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a08af2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+16:22559:x1874438316601472:12345-0@lo:101:mount.lustre.0 Request processed in 201us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604242.787343:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787604242.787434:0:22559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316601472:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787604242.787451:0:22559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ea00/0x6c241a9cc41dd37b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd382 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.787460:0:22559:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ea00/0x6c241a9cc41dd37b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd382 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604242.788581:0:22559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316601600:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787604242.788862:0:22559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604242.788945:0:22559:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a082fffc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787604242.789075:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316601600 00000100:00100000:3.0:1787604242.789082:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316601600 00000100:00100000:3.0:1787604242.789171:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787604242.789182:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a08af2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+16:22559:x1874438316601600:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787604242.789225:0:21914:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787604242.789241:0:21914:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787604242.789243:0:21914:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1787604242.789330:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a08af2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+16:22559:x1874438316601600:12345-0@lo:256:mount.lustre.0 Request processed in 150us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604242.789338:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787604242.789793:0:22559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316601600:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787604242.790482:0:22559:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787604242.790507:0:22559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ea00/0x6c241a9cc41dd37b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd382 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604242.790518:0:22559:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ea00/0x6c241a9cc41dd37b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd382 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787604242.790526:0:22559:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa09f891cd000 from 1 10000000:01000000:0.0:1787604242.790529:0:22559:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787604242.790558:0:22559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa09f89d23400/0x6c241a9cc41dd389 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604242.790566:0:22559:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa09f89d23400/0x6c241a9cc41dd389 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604242.790575:0:22559:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa09f89d23400/0x6c241a9cc41dd389 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604242.790592:0:22559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f11500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316601728:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787604242.790636:0:22559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604242.793332:0:22559:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08898b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787604242.800355:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316601728 00000100:00100000:2.0:1787604242.800371:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316601728 00000100:00100000:2.0:1787604242.800439:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787604242.800451:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a08af28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+16:22559:x1874438316601728:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787604242.800468:0:21915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604242.800485:0:21915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a0bc44f600/0x6c241a9cc41dd390 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd389 expref: -99 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.800514:0:21915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a0bc44f600/0x6c241a9cc41dd390 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd389 expref: 17 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.800524:0:21915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a0bc44f600/0x6c241a9cc41dd390 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd389 expref: 17 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.800533:0:21915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a0bc44f600, rc 0) 00000100:00100000:2.0:1787604242.805282:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a08af28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+17:22559:x1874438316601728:12345-0@lo:101:mount.lustre.0 Request processed in 4823us (14635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604242.805295:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787604242.808739:0:22559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f11500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316601728:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787604242.808777:0:22559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa09f89d23400/0x6c241a9cc41dd389 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd390 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604242.808790:0:22559:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa09f89d23400/0x6c241a9cc41dd389 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd390 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787604242.809359:0:22559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:0.0:1787604242.809858:0:22559:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787604242.810100:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1787604242.810146:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1787604242.810196:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1787604242.810235:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1787604242.810270:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1787604242.810321:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1787604242.810358:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1787604242.810414:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:0.0:1787604242.810465:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1787604242.810504:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:0.0:1787604242.810541:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:0.0:1787604242.810613:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:0.0:1787604242.810621:0:22559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:0.0:1787604242.810748:0:22559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f11500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316601856:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787604242.810815:0:22559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604242.810862:0:22559:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08898b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787604242.811318:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316601856 00000100:00100000:3.0:1787604242.811326:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316601856 00000100:00100000:3.0:1787604242.811389:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787604242.811400:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a08af2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+17:22559:x1874438316601856:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787604242.811658:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a08af2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+17:22559:x1874438316601856:12345-0@lo:501:mount.lustre.0 Request processed in 260us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604242.811666:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787604242.812629:0:22559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f11500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316601856:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787604242.812680:0:22559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f11500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316601984:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787604242.812764:0:22559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604242.812965:0:22559:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08898b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787604242.813006:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316601984 00000100:00100000:3.0:1787604242.813012:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316601984 00000100:00100000:3.0:1787604242.813219:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787604242.813229:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+17:22559:x1874438316601984:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787604242.816577:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+17:22559:x1874438316601984:12345-0@lo:503:mount.lustre.0 Request processed in 3340us (3803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604242.816590:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787604242.816931:0:22559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f11500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316601984:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787604242.817792:0:22559:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787604242.817887:0:22559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7270a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316602112:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787604242.817944:0:22559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604242.817985:0:22559:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0897c5540 going to sleep for 11 seconds 00000100:00100000:3.0:1787604242.818198:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316602112 00000100:00100000:3.0:1787604242.818206:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316602112 00000100:00100000:3.0:1787604242.818252:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787604242.818261:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+17:22559:x1874438316602112:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787604242.818466:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+17:22559:x1874438316602112:12345-0@lo:502:mount.lustre.0 Request processed in 205us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604242.818496:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787604242.818505:0:22559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7270a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316602112:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787604242.818779:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1787604242.818829:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1787604242.818890:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1787604242.818929:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1787604242.818965:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:1.0:1787604242.819012:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:1.0:1787604242.819048:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:1.0:1787604242.819081:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:1.0:1787604242.819131:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1787604242.819168:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:1.0:1787604242.819200:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:1.0:1787604242.819228:0:22559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7270a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316602240:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787604242.819274:0:22559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604242.819300:0:22559:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0897c5540 going to sleep for 11 seconds 00000100:00100000:3.0:1787604242.819683:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316602240 00000100:00100000:3.0:1787604242.819717:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316602240 00000100:00100000:3.0:1787604242.819759:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787604242.819767:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+17:22559:x1874438316602240:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787604242.819965:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+17:22559:x1874438316602240:12345-0@lo:502:mount.lustre.0 Request processed in 197us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604242.819973:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787604242.820084:0:22559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7270a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316602240:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787604242.820187:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:1.0:1787604242.820197:0:22559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787604242.823922:0:22571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787604242.823935:0:22571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604242.823938:0:22571:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787604242.823947:0:22571:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa09f891cd000 00000020:00000080:1.0:1787604242.823949:0:22571:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787604242.823956:0:22571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787604242.823959:0:22571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604242.823960:0:22571:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787604242.823962:0:22571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787604242.823965:0:22571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604242.823966:0:22571:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787604242.823969:0:22571:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa09f891cd000 00000020:00000080:1.0:1787604242.823971:0:22571:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787604242.824057:0:22571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787604242.824061:0:22571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604242.824062:0:22571:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787604242.824073:0:22571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787604242.824076:0:22571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604242.824078:0:22571:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787604242.824081:0:22571:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa09f891cd000 00000020:00000080:1.0:1787604242.824084:0:22571:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787604242.824104:0:22571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787604242.824107:0:22571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604242.824108:0:22571:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787604242.824111:0:22571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787604242.824113:0:22571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604242.824114:0:22571:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787604242.824117:0:22571:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa09f891cd000 00000020:00000080:1.0:1787604242.824119:0:22571:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787604242.824157:0:22571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787604242.824160:0:22571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604242.824162:0:22571:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787604242.824165:0:22571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:3.0:1787604242.825500:0:22559:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787604242.825531:0:22559:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787604242.825741:0:22559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa09f89d23400/0x6c241a9cc41dd389 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd390 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604242.825753:0:22559:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa09f89d23400/0x6c241a9cc41dd389 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd390 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787604242.825810:0:22559:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787604242.825813:0:22559:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa09f891cd000 10000000:01000000:3.0:1787604242.825816:0:22559:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa09f891cd000 10000000:01000000:3.0:1787604242.825820:0:22559:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787604242.825825:0:22559:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa09f891cd000 from 1 10000000:01000000:3.0:1787604242.825828:0:22559:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787604242.825862:0:22559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0c207c000/0x6c241a9cc41dd397 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604242.825870:0:22559:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0a0c207c000/0x6c241a9cc41dd397 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604242.825881:0:22559:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0a0c207c000/0x6c241a9cc41dd397 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604242.825906:0:22559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316602368:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787604242.825956:0:22559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604242.825993:0:22559:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08538e480 going to sleep for 11 seconds 00000100:00100000:0.0:1787604242.826051:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316602368 00000100:00100000:0.0:1787604242.826063:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316602368 00000100:00100000:0.0:1787604242.826110:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787604242.826120:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+17:22559:x1874438316602368:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787604242.826131:0:21913:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604242.826143:0:21913:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09f89d22800/0x6c241a9cc41dd39e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd397 expref: -99 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604242.826164:0:21913:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09f89d22800/0x6c241a9cc41dd39e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd397 expref: 18 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604242.826174:0:21913:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09f89d22800/0x6c241a9cc41dd39e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd397 expref: 18 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604242.826183:0:21913:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09f89d22800, rc 0) 00000100:00100000:0.0:1787604242.826756:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:22559:x1874438316602368:12345-0@lo:101:mount.lustre.0 Request processed in 635us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604242.826762:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787604242.827152:0:22559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316602368:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787604242.827170:0:22559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0a0c207c000/0x6c241a9cc41dd397 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd39e expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.827180:0:22559:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0a0c207c000/0x6c241a9cc41dd397 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd39e expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787604242.828030:0:22559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1787604242.830308:0:22559:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787604242.830700:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1787604242.830760:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1787604242.830795:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1787604242.830846:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1787604242.830884:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1787604242.830930:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1787604242.830980:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1787604242.831016:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1787604242.831065:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1787604242.831102:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1787604242.831133:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000100:00080000:3.0:1787604242.831163:0:21926:0:(import.c:65:import_set_state_nolock()) ffffa0a0bca72800 : changing import state from RECOVER to FULL 00000040:00080000:2.0:1787604242.831175:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1787604242.831207:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1787604242.831237:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000100:00100000:3.0:1787604242.831258:0:21926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3449:x1874438316600832:12345-0@lo:38:llog_process_th.0 Request processed in 87600us (87988us total) trans 0 rc 0/0 00000040:00080000:2.0:1787604242.831282:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1787604242.831321:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1787604242.831356:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000100:00100000:3.0:1787604242.831399:0:21926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:2.0:1787604242.831401:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1787604242.831434:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1787604242.831466:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000100:00100000:3.0:1787604242.831468:0:3449:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787604242.831476:0:3449:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787604242.831484:0:3449:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787604242.831489:0:3449:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787604242.831492:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa0a0bc134000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000040:00080000:2.0:1787604242.831511:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1787604242.831550:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1787604242.831603:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1787604242.831652:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1787604242.831734:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000100:00100000:3.0:1787604242.831749:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3449:1874438316600832:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1787604242.831772:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1787604242.831820:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1787604242.831849:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1787604242.831867:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1787604242.831905:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1787604242.831924:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1787604242.831940:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1787604242.831956:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1787604242.831988:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1787604242.832024:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000100:00100000:3.0:1787604242.832487:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7270a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316602496:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1787604242.832610:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1787604242.832658:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1787604242.832734:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1787604242.832809:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1787604242.832846:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1787604242.832878:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1787604242.832910:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1787604242.832952:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1787604242.832987:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1787604242.833020:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1787604242.833066:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1787604242.833101:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1787604242.833132:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1787604242.833223:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1787604242.833261:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1787604242.834623:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1787604242.834641:0:22559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1787604242.834765:0:22559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316602624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787604242.839712:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604242.839797:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316602496 00000100:00100000:3.0:1787604242.839803:0:21925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316602496 00000100:00100000:3.0:1787604242.839842:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787604242.839852:0:21925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a009c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3452:x1874438316602496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787604242.839892:0:21925:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787604242.839944:0:21925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a009c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3452:x1874438316602496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604242.839952:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787604242.840002:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7270a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316602496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787604242.842331:0:22559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604242.842428:0:22559:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a082fff540 going to sleep for 11 seconds 00000100:00100000:3.0:1787604242.843638:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316602624 00000100:00100000:3.0:1787604242.843648:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316602624 00000100:00100000:2.0:1787604242.843811:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787604242.843822:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:22559:x1874438316602624:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787604242.844106:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:22559:x1874438316602624:12345-0@lo:501:mount.lustre.0 Request processed in 285us (1781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604242.844125:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787604242.844181:0:22559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316602624:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787604242.844231:0:22559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316602752:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787604242.844274:0:22559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604242.844296:0:22559:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a082fff540 going to sleep for 11 seconds 00000100:00100000:3.0:1787604242.844362:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316602752 00000100:00100000:3.0:1787604242.844367:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316602752 00000100:00100000:3.0:1787604242.844398:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787604242.844406:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:22559:x1874438316602752:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787604242.844740:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:22559:x1874438316602752:12345-0@lo:503:mount.lustre.0 Request processed in 334us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604242.844747:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787604242.844790:0:22559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316602752:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787604242.845447:0:22559:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787604242.846801:0:22559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316602880:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787604242.846868:0:22559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604242.846908:0:22559:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a091b7ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787604242.846988:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316602880 00000100:00100000:2.0:1787604242.846995:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316602880 00000100:00100000:2.0:1787604242.847028:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787604242.847035:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:22559:x1874438316602880:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787604242.847254:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:22559:x1874438316602880:12345-0@lo:502:mount.lustre.0 Request processed in 219us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604242.847261:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787604242.847636:0:22559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316602880:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787604242.848983:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1787604242.849048:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1787604242.849085:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1787604242.849137:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1787604242.849188:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1787604242.849235:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1787604242.849273:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1787604242.849308:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1787604242.850118:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1787604242.850163:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1787604242.850198:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1787604242.850242:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1787604242.850275:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1787604242.850308:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1787604242.850648:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1787604242.850738:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1787604242.850791:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1787604242.850834:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1787604242.850868:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1787604242.850901:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1787604242.850979:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1787604242.851019:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1787604242.851050:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1787604242.851097:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1787604242.851132:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1787604242.851168:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1787604242.851216:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1787604242.851254:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1787604242.851294:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1787604242.852106:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1787604242.852154:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1787604242.852186:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1787604242.852220:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1787604242.852263:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1787604242.852300:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1787604242.852416:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1787604242.852617:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1787604242.852659:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1787604242.852854:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1787604242.852898:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1787604242.852932:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1787604242.852966:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1787604242.853016:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1787604242.853050:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1787604242.853083:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1787604242.853131:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1787604242.853167:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1787604242.853200:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1787604242.853269:0:22559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316603008:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787604242.853527:0:22559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604242.853752:0:22559:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a082fff300 going to sleep for 11 seconds 00000100:00100000:3.0:1787604242.853873:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316603008 00000100:00100000:3.0:1787604242.853881:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316603008 00000100:00100000:3.0:1787604242.853959:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787604242.853968:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:22559:x1874438316603008:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787604242.854173:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:22559:x1874438316603008:12345-0@lo:502:mount.lustre.0 Request processed in 205us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604242.854180:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787604242.854256:0:22559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316603008:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787604242.854378:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1787604242.854419:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1787604242.854444:0:22559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f13800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316603136:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787604242.854493:0:22559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604242.854924:0:22559:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08898b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787604242.854970:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316603136 00000100:00100000:2.0:1787604242.854976:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316603136 00000100:00100000:2.0:1787604242.855003:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787604242.855010:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:22559:x1874438316603136:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787604242.855161:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:22559:x1874438316603136:12345-0@lo:502:mount.lustre.0 Request processed in 150us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604242.855167:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787604242.855237:0:22559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f13800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316603136:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787604242.855669:0:22559:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:0.0:1787604242.855713:0:22559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787604242.856936:0:22575:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1787604242.856953:0:22575:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffffa0a0bcfe19b8) 00000020:00000080:0.0:1787604242.856980:0:22575:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1787604242.857053:0:22575:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa09f891cd000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1787604242.857057:0:22575:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa09f891cd000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1787604242.857060:0:22575:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa09f891cd000 3 00010000:00080000:0.0:1787604242.857089:0:22575:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa09f8a5ba800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.116@tcp at head 00010000:00010000:0.0:1787604242.871222:0:22575:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1787604242.871411:0:22575:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1787604242.871446:0:22575:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787604242.874867:0:22575:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x6c241a9cc41dd3ac 00000100:00080000:0.0:1787604242.874886:0:22575:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787604242.874893:0:22575:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffffa09f8a5ba800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1787604242.875813:0:22575:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a0b7270380 x1874438316603264/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787604242.875844:0:22575:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787604242.876950:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3449:1874438316603264:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787604242.877020:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787604242.877079:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787604242.877121:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787604242.877125:0:15520:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787604242.877128:0:15520:0:(import.c:65:import_set_state_nolock()) ffffa09f81b85800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787604242.877137:0:15520:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffffa09f81b85800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1787604242.877153:0:15520:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a0a009dc00 x1874438316603520/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787604242.877165:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787604242.877168:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787604242.877171:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787604242.877174:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787604242.877195:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787604242.877197:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787604242.877200:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787604242.877203:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787604242.877221:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316603264 00000100:00100000:3.0:1787604242.877227:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316603264 00000100:00100000:3.0:1787604242.877262:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787604242.877270:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a009d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3449:x1874438316603264:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787604242.877292:0:21922:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 623 last 0 00000020:00000080:3.0:1787604242.877325:0:21922:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x6c241a9cc41dd3b3 00000004:00100000:3.0:1787604242.877339:0:21922:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787604242.877367:0:21922:0:(import.c:65:import_set_state_nolock()) ffffa09f8895f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787604242.877410:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a009d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3449:x1874438316603264:12345-0@lo:38:llog_process_th.0 Request processed in 139us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604242.877423:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787604242.877446:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3453:1874438316603392:0@lo:400:kworker.0 00000100:00100000:3.0:1787604242.877494:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604242.877524:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316603520:0@lo:38:kworker.0 00000100:00100000:1.0:1787604242.877790:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3450:1874438316603648:0@lo:400:kworker.0 00000100:00100000:1.0:1787604242.877822:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604242.877841:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787604242.877847:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316603776:0@lo:400:kworker.0 00000100:00100000:3.0:1787604242.879697:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787604242.879782:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0a0b7270380 x1874438316603264/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787604252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604242.879793:0:3449:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787604242.879803:0:3449:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787604242.879810:0:3449:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787604242.879816:0:3449:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787604242.879818:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f8a5ba800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787604242.879824:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3449:1874438316603264:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787604242.879872:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316603648 00000100:00100000:3.0:1787604242.879877:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316603648 00000100:00100000:3.0:1787604242.879918:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787604242.879928:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1874438316603648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604242.879990:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1874438316603648:12345-0@lo:400:kworker.0 Request processed in 63us (2166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604242.879997:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787604242.880020:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316603392 00000100:00100000:3.0:1787604242.880024:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316603392 00000100:00100000:3.0:1787604242.880047:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787604242.880053:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:3453:x1874438316603392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604242.880102:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:3453:x1874438316603392:12345-0@lo:400:kworker.0 Request processed in 49us (2607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604242.880109:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787604242.880139:0:21926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316603520 00000100:00100000:3.0:1787604242.880143:0:21926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316603520 00000100:00100000:3.0:1787604242.880162:0:21926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787604242.880166:0:21926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a009f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3449:x1874438316603520:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787604242.880206:0:21926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a009f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3449:x1874438316603520:12345-0@lo:38:kworker.0 Request processed in 39us (526us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787604242.880212:0:21926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787604242.880237:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3453:1874438316603392:0@lo:400:kworker.0 00000100:00080000:3.0:1787604242.880264:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f81b85800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787604242.880268:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787604242.880271:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316603520:0@lo:38:kworker.0 00000100:00100000:3.0:1787604242.880286:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787604242.880313:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0a0a009e680 x1874438316603648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604242.880323:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3450:1874438316603648:0@lo:400:kworker.0 00000100:00100000:3.0:1787604242.880339:0:22565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316603776 00000100:00100000:3.0:1787604242.880342:0:22565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316603776 00000100:00100000:3.0:1787604242.880364:0:22565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787604242.880371:0:22565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a009dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3450:x1874438316603776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604242.880408:0:22565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a009dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3450:x1874438316603776:12345-0@lo:400:kworker.0 Request processed in 37us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604242.880414:0:22565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787604242.880449:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316603776:0@lo:400:kworker.0 00000040:00080000:1.0:1787604242.881039:0:22575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:2.0:1787604242.881991:0:22559:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787604242.882020:0:22559:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787604242.882253:0:22559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0c207c000/0x6c241a9cc41dd397 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd39e expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.882264:0:22559:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0a0c207c000/0x6c241a9cc41dd397 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd39e expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787604242.882313:0:22559:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787604242.882315:0:22559:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787604242.882316:0:22559:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787604242.882317:0:22559:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787604242.882318:0:22559:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787604242.882319:0:22559:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787604242.882321:0:22559:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787604242.882322:0:22559:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787604242.882324:0:22559:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787604242.882327:0:22559:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1787604242.882329:0:22559:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787604242.882330:0:22559:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787604242.882331:0:22559:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787604242.882332:0:22559:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787604242.882333:0:22559:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787604242.882340:0:22559:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787604242.882341:0:22559:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787604242.882342:0:22559:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787604242.882342:0:22559:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787604242.882364:0:22559:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787604242.882383:0:22559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d92d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316603904:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787604242.882437:0:22559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604242.882485:0:22559:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a082fff300 going to sleep for 11 seconds 00000100:00100000:3.0:1787604242.884518:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316603904 00000100:00100000:3.0:1787604242.884529:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316603904 00000100:00100000:3.0:1787604242.884592:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787604242.884603:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:22559:x1874438316603904:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787604242.884634:0:21914:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787604242.884647:0:21914:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787604242.954744:0:21914:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787604242.954765:0:21914:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1787604242.954790:0:21936:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787604242.954795:0:21936:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000001:00100000:3.0:1787604242.954800:0:6460:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00010000:0.0:1787604242.954819:0:21936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd3ba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604242.954838:0:21936:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0a0bc44e200/0x6c241a9cc41dd2be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd2b7 expref: 18 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604242.954844:0:21936:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0a0bc44ec00/0x6c241a9cc41dd382 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd37b expref: 18 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604242.954851:0:21936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd3ba lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604242.954887:0:21936:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0a0bc44ec00/0x6c241a9cc41dd382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c241a9cc41dd37b expref: 18 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604242.954902:0:21936:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0a0bc44ec00/0x6c241a9cc41dd382 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c241a9cc41dd37b expref: 18 pid: 21913 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604242.954940:0:21936:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f13800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21936:1874438316604032:0@lo:104: 00000100:00100000:0.0:1787604242.955000:0:21936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787604242.955048:0:21936:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0a0bc44e200/0x6c241a9cc41dd2be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c241a9cc41dd2b7 expref: 18 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604242.955056:0:21936:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0a0bc44e200/0x6c241a9cc41dd2be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c241a9cc41dd2b7 expref: 18 pid: 21914 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604242.955065:0:21936:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f11c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21936:1874438316604160:0@lo:104: 00000100:00100000:0.0:1787604242.955088:0:21936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604242.955111:0:21936:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a083668000 going to sleep for 11 seconds 00000100:00100000:1.0:1787604242.955130:0:21903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316604032 00000100:00100000:1.0:1787604242.955138:0:21903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316604032 00000100:00100000:0.0:1787604242.955142:0:21904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316604160 00000100:00100000:0.0:1787604242.955144:0:21904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316604160 00000100:00100000:0.0:1787604242.955170:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787604242.955178:0:21904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a084f13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+4:21936:x1874438316604032:12345-0@lo:104: 00010000:00010000:0.0:1787604242.955188:0:21904:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ea00/0x6c241a9cc41dd37b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c241a9cc41dd382 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604242.955233:0:21904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787604242.955239:0:21904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a084f13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+4:21936:x1874438316604032:12345-0@lo:104: Request processed in 61us (238us total) trans 0 rc 0/0 00010000:00010000:1.0:1787604242.966399:0:21908:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787604242.966413:0:21908:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ea00/0x6c241a9cc41dd37b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c241a9cc41dd382 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604242.966445:0:21908:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc44ea00 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:1.0:1787604242.966449:0:21908:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ea00/0x6c241a9cc41dd37b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c241a9cc41dd382 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604242.966459:0:21908:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ea00/0x6c241a9cc41dd37b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c241a9cc41dd382 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787604242.966465:0:21908:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ea00/0x6c241a9cc41dd37b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c241a9cc41dd382 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787604242.966470:0:21908:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787604242.966520:0:21908:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ea00/0x6c241a9cc41dd37b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd382 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604242.966526:0:21908:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787604242.966550:0:21908:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ea00/0x6c241a9cc41dd37b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd382 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604242.966557:0:21908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ea00/0x6c241a9cc41dd37b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd382 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604242.966573:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604242.966575:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604242.966577:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604242.966864:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7270e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3452:1874438316604288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787604242.966931:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604242.967793:0:21905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316604288 00000100:00100000:1.0:1787604242.967802:0:21905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316604288 00010000:00010000:1.0:1787604242.967836:0:21905:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0a0bc44ec00/0x6c241a9cc41dd382 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c241a9cc41dd37b expref: 19 pid: 21913 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604242.967874:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787604242.967908:0:21905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a009ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+19:3452:x1874438316604288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787604242.967927:0:21905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604242.967933:0:21905:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0a0bc44ec00/0x6c241a9cc41dd382 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c241a9cc41dd37b expref: 19 pid: 21913 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604242.967949:0:21905:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0a0bc44ec00/0x6c241a9cc41dd382 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c241a9cc41dd37b expref: 19 pid: 21913 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604242.967967:0:21905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787604242.968023:0:21905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a009ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+19:3452:x1874438316604288:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604242.968032:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787604242.968051:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7270e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3452:1874438316604288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787604242.970470:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787604242.970560:0:21936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0bc44ec00/0x6c241a9cc41dd382 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c241a9cc41dd37b expref: 18 pid: 21913 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604242.970578:0:21936:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f13800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21936:1874438316604032:0@lo:104: 00000100:00100000:0.0:1787604242.970605:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787604242.970632:0:21904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a084f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+3:21936:x1874438316604160:12345-0@lo:104: 00010000:00010000:0.0:1787604242.970648:0:21904:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c241a9cc41dd2be expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604242.970760:0:21904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787604242.970768:0:21904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a084f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+3:21936:x1874438316604160:12345-0@lo:104: Request processed in 142us (15679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604242.970775:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787604242.972114:0:21936:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f11c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21936:1874438316604160:0@lo:104: 00010000:00010000:1.0:1787604242.972156:0:21936:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd3ba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604242.972438:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787604242.972447:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c241a9cc41dd2be expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604242.972455:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0c207ca00 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:3.0:1787604242.972460:0:21909:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c241a9cc41dd2be expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604242.972471:0:21909:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c241a9cc41dd2be expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787604242.972478:0:21909:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c241a9cc41dd2be expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787604242.972484:0:21909:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787604242.972580:0:21909:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd2be expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604242.972599:0:21909:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787604242.972622:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd2be expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604242.972629:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0a0c207ca00/0x6c241a9cc41dd2b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd2be expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604242.972648:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604242.972650:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604242.972652:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604242.972666:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3453:1874438316604416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787604242.972750:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604242.972883:0:21907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316604416 00000100:00100000:2.0:1787604242.972891:0:21907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316604416 00010000:00010000:2.0:1787604242.972917:0:21907:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0a0bc44e200/0x6c241a9cc41dd2be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c241a9cc41dd2b7 expref: 18 pid: 21914 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604242.972995:0:21907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787604242.973004:0:21907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a009ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:3453:x1874438316604416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787604242.973016:0:21907:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787604242.973022:0:21907:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0a0bc44e200/0x6c241a9cc41dd2be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c241a9cc41dd2b7 expref: 18 pid: 21914 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.973032:0:21907:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0a0bc44e200/0x6c241a9cc41dd2be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c241a9cc41dd2b7 expref: 18 pid: 21914 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.973044:0:21907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0bc44e200/0x6c241a9cc41dd2be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c241a9cc41dd2b7 expref: 18 pid: 21914 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.973057:0:21907:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd3ba lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.973063:0:21907:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd3ba lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787604242.973077:0:21907:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.018282278s 00010000:00010000:2.0:1787604242.973087:0:21907:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd3ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.973093:0:21907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd3ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.973100:0:21907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd3ba lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.973106:0:21907:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd3ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.973112:0:21907:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09f89d22000 already unused, calling callback (ffffffffc175e230) 00010000:00010000:2.0:1787604242.973116:0:21907:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd3ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.973123:0:21907:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd3ba lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.973146:0:21907:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd3ba lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604242.973156:0:21907:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787604242.973223:0:21907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a009ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+17:3453:x1874438316604416:12345-0@lo:103:ldlm_bl.0 Request processed in 219us (471us total) trans 0 rc 0/0 00010000:00010000:3.0:1787604242.973226:0:21936:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd3ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604242.973240:0:21907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787604242.973242:0:21936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd3ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604242.973250:0:21936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd3ba lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604242.973276:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3453:1874438316604416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787604242.976445:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+16:22559:x1874438316603904:12345-0@lo:253:mount.lustre.0 Request processed in 91835us (93998us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604242.976459:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787604242.976580:0:22559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d92d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:22559:1874438316603904:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787604242.976594:0:22559:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787604242.976598:0:22559:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787604242.976599:0:22559:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787604242.976600:0:22559:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787604242.976601:0:22559:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787604242.976603:0:22559:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787604242.976604:0:22559:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787604242.976605:0:22559:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787604242.976607:0:22559:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787604242.976608:0:22559:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787604242.976622:0:22559:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787604242.978172:0:22559:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/8/4) registered 00080000:10000000:0.0:1787604242.978435:0:22559:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787604242.979138:0:22559:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787604242.979305:0:22559:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787604242.979598:0:22559:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787604242.980180:0:22559:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787604242.981058:0:22559:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787604242.981166:0:22559:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787604242.981541:0:22559:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:0.0:1787604242.981869:0:22559:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787604242.982051:0:22559:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x9:0x0] (8/8/4) registered 00080000:10000000:0.0:1787604242.982152:0:22559:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000040:01000000:3.0:1787604242.984365:0:22559:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1787604242.985215:0:22583:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1787604242.985221:0:22583:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787604242.985503:0:22584:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787604242.985629:0:22559:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:3.0:1787604242.985661:0:22584:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787604242.986404:0:22585:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f12680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22585:1874438316604544:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1787604242.986875:0:22559:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1787604242.986996:0:22559:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787604242.987414:0:22559:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787604242.987423:0:22559:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1787604242.987552:0:22559:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787604242.988502:0:22559:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787604242.989094:0:22559:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787604242.989130:0:22559:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:0.0:1787604242.989227:0:22585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604242.989277:0:22585:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a085b95e40 going to sleep for 11 seconds 00000040:00080000:1.0:1787604242.989365:0:22559:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787604242.989376:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316604544 00000100:00100000:2.0:1787604242.989384:0:21925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316604544 00000100:00100000:2.0:1787604242.989435:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787604242.989444:0:21925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a084f10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:22585:x1874438316604544:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787604242.989543:0:21925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a084f10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:22585:x1874438316604544:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 100us (3059us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604242.989551:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787604242.989609:0:22585:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f12680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22585:1874438316604544:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1787604242.989645:0:22585:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787604242.989714:0:22585:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d91500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22585:1874438316604672:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787604242.989770:0:22585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604242.989793:0:21926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316604672 00000100:00100000:2.0:1787604242.989797:0:21926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316604672 00000100:00100000:2.0:1787604242.989820:0:21926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787604242.989826:0:21926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:22585:x1874438316604672:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787604242.989937:0:21926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:22585:x1874438316604672:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 110us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604242.989943:0:21926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787604242.989959:0:22585:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08569a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787604242.989971:0:22585:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d91500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22585:1874438316604672:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787604242.992403:0:22585:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d91500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:22585:1874438316604800:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787604242.992472:0:22585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604242.992542:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316604800 00000100:00100000:2.0:1787604242.992549:0:21931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316604800 00000100:00100000:2.0:1787604242.992589:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787604242.992598:0:21931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:22585:x1874438316604800:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787604242.992662:0:21931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:22585:x1874438316604800:12345-0@lo:900:lod0001_rec0000.0 Request processed in 64us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604242.992669:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787604242.992715:0:22585:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08569a0c0 going to sleep for 11 seconds 00010000:00080000:2.0:1787604242.992748:0:22585:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa09f89d91500 x1874438316604800/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787604258 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787604242.992761:0:22585:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d91500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:22585:1874438316604800:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787604242.992818:0:22585:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d91500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22585:1874438316604928:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787604242.992861:0:22585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604242.992883:0:21926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316604928 00000100:00100000:2.0:1787604242.992887:0:21926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316604928 00000100:00100000:2.0:1787604242.992911:0:21926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787604242.992916:0:21926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:22585:x1874438316604928:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787604242.992972:0:21926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:22585:x1874438316604928:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 55us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604242.992979:0:21926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787604242.992997:0:22585:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08569a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787604242.993025:0:22585:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d91500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22585:1874438316604928:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1787604242.993071:0:22585:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787604242.995376:0:22559:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x31:0x0] (8/8/4) registered 00000040:00080000:3.0:1787604242.995651:0:22584:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787604242.995743:0:22584:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000001:00000004:1.0:1787604243.003147:0:22559:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000040:00080000:2.0:1787604243.003967:0:22585:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787604243.004029:0:22585:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787604243.004034:0:22585:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:0.0:1787604243.054193:0:22559:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787604243.054245:0:22559:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb18e01d0b988 00100000:10000000:0.0:1787604243.054257:0:22559:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1787604243.055203:0:22559:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787604243.055260:0:22559:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.116@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787604243.055277:0:22559:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787604243.055309:0:22559:0:(super25.c:182:lustre_fill_super()) lustre-mdt2/mdt2: Mount complete 00000100:00100000:1.0:1787604243.319189:0:21965:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a091b7a600 going to sleep for 0 seconds 00010000:00010000:0.0:1787604243.894972:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787604243.959289:0:22580:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787604244.341863:0:21965:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a091b7a600 going to sleep for 0 seconds 10000000:01000000:2.0:1787604244.541129:0:21917:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787604244.541140:0:21917:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa09f891cd000 from 12 10000000:01000000:2.0:1787604244.541172:0:21917:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787604244.541238:0:21917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e800/0x6c241a9cc41dd3c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604244.541252:0:21917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e800/0x6c241a9cc41dd3c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604244.541265:0:21917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e800/0x6c241a9cc41dd3c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604244.541298:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316605056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787604244.541391:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604244.541446:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0a0477d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787604244.541458:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316605056 00000100:00100000:1.0:1787604244.541488:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316605056 00000100:00100000:1.0:1787604244.541559:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787604244.541570:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+16:21917:x1874438316605056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787604244.541585:0:21915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604244.541601:0:21915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a0813d2200/0x6c241a9cc41dd3c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd3c1 expref: -99 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604244.541628:0:21915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a0813d2200/0x6c241a9cc41dd3c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd3c1 expref: 17 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604244.541639:0:21915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a0813d2200/0x6c241a9cc41dd3c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd3c1 expref: 17 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604244.541650:0:21915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a0813d2200, rc 0) 00000100:00100000:1.0:1787604244.541741:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+17:21917:x1874438316605056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604244.541749:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787604244.541849:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316605056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787604244.541870:0:21917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e800/0x6c241a9cc41dd3c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd3c8 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604244.541880:0:21917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e800/0x6c241a9cc41dd3c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd3c8 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604244.541938:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316605184:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787604244.541978:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604244.542015:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0a0477d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787604244.542034:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316605184 00000100:00100000:3.0:1787604244.542040:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316605184 00000100:00100000:3.0:1787604244.542087:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787604244.542096:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+17:21917:x1874438316605184:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787604244.542113:0:21914:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787604244.542131:0:21914:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787604244.542135:0:21914:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1787604244.542234:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+17:21917:x1874438316605184:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 139us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604244.542242:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787604244.542264:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316605184:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787604244.542316:0:21917:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787604244.542323:0:21917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e800/0x6c241a9cc41dd3c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd3c8 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604244.542341:0:21917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e800/0x6c241a9cc41dd3c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd3c8 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604244.542352:0:21917:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787604244.542355:0:21917:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0a0bc52f000 from 12 10000000:01000000:2.0:1787604244.542358:0:21917:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787604244.542377:0:21917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f400/0x6c241a9cc41dd3cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604244.542385:0:21917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f400/0x6c241a9cc41dd3cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604244.542392:0:21917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f400/0x6c241a9cc41dd3cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604244.542405:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316605312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787604244.542432:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604244.542496:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a088b37240 going to sleep for 11 seconds 00000100:00100000:3.0:1787604244.543929:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316605312 00000100:00100000:3.0:1787604244.543944:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316605312 00000100:00100000:3.0:1787604244.544011:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787604244.544022:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+17:21917:x1874438316605312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787604244.544038:0:21913:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604244.544057:0:21913:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a0c207ca00/0x6c241a9cc41dd3d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd3cf expref: -99 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604244.544089:0:21913:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a0c207ca00/0x6c241a9cc41dd3d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd3cf expref: 18 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604244.544102:0:21913:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a0c207ca00/0x6c241a9cc41dd3d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd3cf expref: 18 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604244.544112:0:21913:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a0c207ca00, rc 0) 00000100:00100000:3.0:1787604244.544193:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:21917:x1874438316605312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (1760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604244.544200:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787604244.544355:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316605312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787604244.544376:0:21917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f400/0x6c241a9cc41dd3cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd3d6 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604244.544386:0:21917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f400/0x6c241a9cc41dd3cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd3d6 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604244.544461:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316605440:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787604244.544504:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604244.544550:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a088b37240 going to sleep for 11 seconds 00000100:00100000:3.0:1787604244.544595:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316605440 00000100:00100000:3.0:1787604244.544600:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316605440 00000100:00100000:3.0:1787604244.544629:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787604244.544642:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:21917:x1874438316605440:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787604244.544659:0:21915:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787604244.544674:0:21915:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787604244.544677:0:21915:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1787604244.545107:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:21917:x1874438316605440:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 463us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604244.545115:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787604244.545946:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316605440:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787604244.546017:0:21917:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787604244.546030:0:21917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f400/0x6c241a9cc41dd3cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd3d6 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604244.546041:0:21917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f400/0x6c241a9cc41dd3cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd3d6 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604244.918098:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787604244.989981:0:22580:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787604245.367573:0:21965:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a091b7a600 going to sleep for 0 seconds 00010000:00010000:2.0:1787604245.942031:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604246.390635:0:21965:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a091b7a600 going to sleep for 0 seconds 00010000:00010000:1.0:1787604246.969399:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787604247.395913:0:22830:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787604247.415790:0:21965:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a091b7a600 going to sleep for 0 seconds 00010000:00010000:2.0:1787604247.989970:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604248.055043:0:3451:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787604248.055072:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7271500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316605568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787604248.055176:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787604248.055275:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787604248.055280:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787604248.055284:0:37:0:(import.c:65:import_set_state_nolock()) ffffa09f81b85800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787604248.055295:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffffa09f81b85800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1787604248.055319:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a0b7270000 x1874438316605824/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787604248.055360:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787604248.055364:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787604248.055367:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787604248.055371:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787604248.055395:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787604248.055400:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787604248.055402:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787604248.055406:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787604248.055436:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7270000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316605824:0@lo:38:kworker.0 00000100:00100000:1.0:1787604248.055467:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604248.055499:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7271880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3452:1874438316605952:0@lo:400:kworker.0 00000100:00100000:1.0:1787604248.055537:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604248.055558:0:3452:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787604248.055564:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7272680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3452:1874438316606080:0@lo:400:kworker.0 00000100:00100000:1.0:1787604248.055593:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604248.055631:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316605952 00000100:00100000:1.0:1787604248.055641:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316605952 00000100:00100000:1.0:1787604248.055739:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316606080 00000100:00100000:1.0:1787604248.055743:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316606080 00000100:00100000:1.0:1787604248.055765:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787604248.055775:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3452:x1874438316605952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604248.055843:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3452:x1874438316605952:12345-0@lo:400:kworker.0 Request processed in 67us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604248.055861:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787604248.055883:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787604248.055889:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3452:x1874438316606080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604248.055918:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3452:x1874438316606080:12345-0@lo:400:kworker.0 Request processed in 30us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604248.055925:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787604248.055974:0:3452:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0a0b7272680 x1874438316606080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604248.055990:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7272680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3452:1874438316606080:0@lo:400:kworker.0 00010000:00080000:1.0:1787604248.056001:0:3452:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0a0b7271880 x1874438316605952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604248.056008:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7271880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3452:1874438316605952:0@lo:400:kworker.0 00000100:00100000:1.0:1787604248.056035:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7273800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3451:1874438316605696:0@lo:400:kworker.0 00000100:00100000:1.0:1787604248.056070:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604248.056674:0:21926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316605568 00000100:00100000:2.0:1787604248.056682:0:21926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316605568 00000100:00100000:2.0:1787604248.056756:0:21926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316605824 00000100:00100000:2.0:1787604248.056760:0:21926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316605824 00000100:00100000:2.0:1787604248.056774:0:21926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787604248.056782:0:21926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316605568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787604248.056831:0:21926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787604248.056901:0:21926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316605568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (1726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604248.056909:0:21926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787604248.056924:0:21926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787604248.056929:0:21926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3449:x1874438316605824:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787604248.056959:0:21926:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 628 last 0 00000020:00000080:2.0:1787604248.057007:0:21926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6c241a9cc41dd3dd 00000004:00100000:2.0:1787604248.057025:0:21926:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787604248.057045:0:21926:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:2.0:1787604248.057327:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316605696 00000100:00100000:2.0:1787604248.057332:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316605696 00000100:00100000:2.0:1787604248.057365:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787604248.057372:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:3451:x1874438316605696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604248.058545:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:3451:x1874438316605696:12345-0@lo:400:kworker.0 Request processed in 1167us (2468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604248.058557:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787604248.058732:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7273800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3451:1874438316605696:0@lo:400:kworker.0 00000100:00100000:2.0:1787604248.058758:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7271500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316605568:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1787604248.084894:0:21926:0:(import.c:65:import_set_state_nolock()) ffffa09f88833800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787604248.085085:0:21926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3449:x1874438316605824:12345-0@lo:38:kworker.0 Request processed in 28150us (29613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604248.085099:0:21926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787604248.085272:0:3449:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1787604248.089319:0:3449:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787604248.089336:0:3449:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787604248.089342:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f81b85800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1787604248.089373:0:3449:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000030c9378f): req@ffffa0a084f11880 x1874438316598272/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604248.089404:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7270000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316605824:0@lo:38:kworker.0 00000100:00100000:3.0:1787604248.089620:0:21965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604248.089667:0:21965:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a091b7a600 going to sleep for 11 seconds 00000100:00100000:2.0:1787604248.089862:0:3451:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787604248.089880:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316606208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787604248.089919:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604248.090051:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316598272 00000100:00100000:1.0:1787604248.090061:0:21925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316598272 00000100:00100000:1.0:1787604248.090142:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316606208 00000100:00100000:1.0:1787604248.090148:0:21925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316606208 00000100:00100000:1.0:1787604248.090169:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787604248.090180:0:21925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a009ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:21965:x1874438316598272:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787604248.090301:0:21925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a009ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:21965:x1874438316598272:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 122us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604248.090309:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787604248.090328:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787604248.090334:0:21925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3451:x1874438316606208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787604248.090368:0:21925:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787604248.090406:0:21925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3451:x1874438316606208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604248.090413:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787604248.090504:0:21965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f11880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:21965:1874438316598272:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1787604248.090562:0:21965:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787604248.090603:0:21965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009c000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:21965:1874438316606336:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787604248.090642:0:21965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604248.090677:0:21965:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09f89b69180 going to sleep for 11 seconds 00000100:00100000:3.0:1787604248.090749:0:22565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316606336 00000100:00100000:3.0:1787604248.090755:0:22565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316606336 00000100:00100000:3.0:1787604248.090778:0:22565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787604248.090784:0:22565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a009f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:21965:x1874438316606336:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787604248.090954:0:22565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a009f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:21965:x1874438316606336:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 168us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604248.090961:0:22565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787604248.090988:0:21965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009c000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:21965:1874438316606336:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787604248.091064:0:21965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009c000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:21965:1874438316606464:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787604248.091088:0:21965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604248.091102:0:21965:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09f89b69180 going to sleep for 11 seconds 00000100:00100000:3.0:1787604248.091113:0:22565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316606464 00000100:00100000:3.0:1787604248.091127:0:22565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316606464 00000100:00100000:3.0:1787604248.091147:0:22565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787604248.091153:0:22565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a009d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:21965:x1874438316606464:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787604248.091204:0:22565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a009d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:21965:x1874438316606464:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 52us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604248.091210:0:22565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787604248.091231:0:21965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009c000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:21965:1874438316606464:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1787604248.091279:0:21965:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787604248.093403:0:21965:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787604248.093518:0:21965:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 17, retries 0 00000004:00080000:3.0:1787604248.093524:0:21965:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:2.0:1787604248.094043:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316606208:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787604249.014072:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604250.038309:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787604250.405190:0:22980:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff03f59c90 20000000:00000080:0.0:1787604250.405211:0:22980:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa09f810c9c00 uarg=0000000000000000 20000000:01000000:0.0:1787604250.405247:0:22980:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787604250.405254:0:22980:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787604250.405260:0:22980:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787604250.413538:0:22981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1787604250.413788:0:22980:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787604250.426507:0:22980:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787604250.426539:0:22980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0a0813d2000/0x6c241a9cc41dd3e4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604250.426560:0:22980:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0a0c207dc00/0x6c241a9cc41dd28d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd286 expref: 17 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604250.426567:0:22980:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0a0bc44f600/0x6c241a9cc41dd390 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd389 expref: 17 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604250.426575:0:22980:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0a0813d2000/0x6c241a9cc41dd3e4 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604250.426620:0:22980:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0a0bc44f600/0x6c241a9cc41dd390 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c241a9cc41dd389 expref: 17 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604250.426651:0:22980:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0a0bc44f600/0x6c241a9cc41dd390 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c241a9cc41dd389 expref: 17 pid: 21915 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604250.426666:0:22980:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7270000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:22980:1874438316606592:0@lo:104: 00000100:00100000:1.0:1787604250.426825:0:22980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787604250.427066:0:22980:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0a0c207dc00/0x6c241a9cc41dd28d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c241a9cc41dd286 expref: 17 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604250.427074:0:22980:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0a0c207dc00/0x6c241a9cc41dd28d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c241a9cc41dd286 expref: 17 pid: 21915 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604250.427082:0:22980:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7272680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:22980:1874438316606720:0@lo:104: 00000100:00100000:1.0:1787604250.427102:0:22980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604250.427264:0:22980:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a085538cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787604250.427309:0:21904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316606592 00000100:00100000:0.0:1787604250.427316:0:21904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316606592 00000100:00100000:0.0:1787604250.427358:0:21904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316606720 00000100:00100000:0.0:1787604250.427361:0:21904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316606720 00000100:00100000:0.0:1787604250.427375:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787604250.427461:0:21904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7271880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+4:22980:x1874438316606592:12345-0@lo:104: 00010000:00010000:0.0:1787604250.427474:0:21904:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa09f89d23400/0x6c241a9cc41dd389 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c241a9cc41dd390 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604250.427526:0:21904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787604250.427532:0:21904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7271880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+4:22980:x1874438316606592:12345-0@lo:104: Request processed in 75us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604250.427538:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787604250.427555:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787604250.427561:0:21904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7271180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+3:22980:x1874438316606720:12345-0@lo:104: 00010000:00010000:0.0:1787604250.427568:0:21904:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa09f89d23200/0x6c241a9cc41dd286 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c241a9cc41dd28d expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604250.427598:0:21904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787604250.427603:0:21904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7271180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+3:22980:x1874438316606720:12345-0@lo:104: Request processed in 42us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604250.427608:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787604250.427623:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787604250.427628:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa09f89d23400/0x6c241a9cc41dd389 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c241a9cc41dd390 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604250.427634:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09f89d23400 already unused, calling callback (ffffffffc1d46c20) 00000100:00100000:1.0:1787604250.427637:0:22980:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7270000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:22980:1874438316606592:0@lo:104: 10000000:00010000:0.0:1787604250.427638:0:21909:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa09f89d23400/0x6c241a9cc41dd389 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c241a9cc41dd390 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604250.427645:0:22980:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7272680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:22980:1874438316606720:0@lo:104: 00010000:00010000:0.0:1787604250.427647:0:21909:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa09f89d23400/0x6c241a9cc41dd389 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c241a9cc41dd390 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787604250.427653:0:21909:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa09f89d23400/0x6c241a9cc41dd389 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c241a9cc41dd390 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604250.427662:0:22980:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0a0813d2000/0x6c241a9cc41dd3e4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787604250.427665:0:21909:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787604250.427724:0:21909:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa09f89d23400/0x6c241a9cc41dd389 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd390 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604250.427727:0:21908:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604250.427732:0:21909:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787604250.427749:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa09f89d23400/0x6c241a9cc41dd389 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd390 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604250.427756:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa09f89d23400/0x6c241a9cc41dd389 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd390 expref: -99 pid: 22559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604250.427762:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1787604250.427766:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604250.427768:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604250.427769:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604250.427772:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3450:1874438316606848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787604250.427809:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604250.427841:0:21905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316606848 00000100:00100000:0.0:1787604250.427845:0:21905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316606848 00010000:00010000:0.0:1787604250.427926:0:21905:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0a0bc44f600/0x6c241a9cc41dd390 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c241a9cc41dd389 expref: 18 pid: 21915 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604250.427995:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787604250.428003:0:21905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7272680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:3450:x1874438316606848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787604250.428024:0:21905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787604250.428030:0:21905:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0a0bc44f600/0x6c241a9cc41dd390 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c241a9cc41dd389 expref: 18 pid: 21915 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604250.428040:0:21905:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0a0bc44f600/0x6c241a9cc41dd390 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c241a9cc41dd389 expref: 18 pid: 21915 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604250.428054:0:21905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0bc44f600/0x6c241a9cc41dd390 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c241a9cc41dd389 expref: 18 pid: 21915 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604250.428073:0:21905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787604250.428102:0:21905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7272680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+17:3450:x1874438316606848:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604250.428109:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787604250.428303:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3450:1874438316606848:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787604250.430104:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604250.430109:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604250.430111:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604250.430214:0:21908:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa09f89d23200/0x6c241a9cc41dd286 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c241a9cc41dd28d expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604250.430301:0:21908:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09f89d23200 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:1.0:1787604250.430316:0:21908:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa09f89d23200/0x6c241a9cc41dd286 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c241a9cc41dd28d expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604250.430327:0:21908:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa09f89d23200/0x6c241a9cc41dd286 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c241a9cc41dd28d expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787604250.430333:0:21908:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa09f89d23200/0x6c241a9cc41dd286 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c241a9cc41dd28d expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787604250.430337:0:21908:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787604250.430405:0:21908:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa09f89d23200/0x6c241a9cc41dd286 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd28d expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604250.430410:0:21908:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787604250.430438:0:21908:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa09f89d23200/0x6c241a9cc41dd286 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd28d expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604250.430445:0:21908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa09f89d23200/0x6c241a9cc41dd286 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd28d expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604250.430457:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7270000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3452:1874438316606976:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787604250.430460:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604250.430462:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604250.430463:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604250.430684:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604250.430785:0:21906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316606976 00000100:00100000:0.0:1787604250.430792:0:21906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316606976 00010000:00010000:0.0:1787604250.430820:0:21906:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0a0c207dc00/0x6c241a9cc41dd28d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c241a9cc41dd286 expref: 17 pid: 21915 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604250.430943:0:21906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787604250.430955:0:21906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+17:3452:x1874438316606976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787604250.430966:0:21906:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787604250.430972:0:21906:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0a0c207dc00/0x6c241a9cc41dd28d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c241a9cc41dd286 expref: 17 pid: 21915 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604250.430983:0:21906:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0a0c207dc00/0x6c241a9cc41dd28d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c241a9cc41dd286 expref: 17 pid: 21915 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604250.430996:0:21906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0c207dc00/0x6c241a9cc41dd28d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c241a9cc41dd286 expref: 17 pid: 21915 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604250.431021:0:21906:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0a0813d2000/0x6c241a9cc41dd3e4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604250.431045:0:21906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a0813d2000/0x6c241a9cc41dd3e4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604250.431060:0:21906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0a0813d2000/0x6c241a9cc41dd3e4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604250.431067:0:21906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0a0813d2000/0x6c241a9cc41dd3e4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604250.431073:0:21906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0a0813d2000/0x6c241a9cc41dd3e4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604250.431079:0:21906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0a0813d2000/0x6c241a9cc41dd3e4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604250.431084:0:21906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0813d2000 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604250.431089:0:21906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0a0813d2000/0x6c241a9cc41dd3e4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604250.431096:0:21906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0a0813d2000/0x6c241a9cc41dd3e4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604250.431114:0:21906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0a0813d2000/0x6c241a9cc41dd3e4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604250.431133:0:22980:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0a0813d2000/0x6c241a9cc41dd3e4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604250.431141:0:22980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0a0813d2000/0x6c241a9cc41dd3e4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604250.431147:0:22980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0813d2000/0x6c241a9cc41dd3e4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604250.431790:0:21906:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787604250.431845:0:21906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+16:3452:x1874438316606976:12345-0@lo:103:ldlm_bl.0 Request processed in 891us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604250.431924:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7270000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3452:1874438316606976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787604250.431928:0:21906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787604251.061858:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787604251.509869:0:21917:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787604251.509876:0:21917:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa09f891cd000 from 13 10000000:01000000:1.0:1787604251.509881:0:21917:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787604251.509927:0:21917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3200/0x6c241a9cc41dd3eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604251.509940:0:21917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3200/0x6c241a9cc41dd3eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604251.509952:0:21917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3200/0x6c241a9cc41dd3eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604251.509977:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7273100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316607104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787604251.512314:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604251.512356:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09f89b69900 going to sleep for 11 seconds 00000100:00100000:3.0:1787604251.512443:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316607104 00000100:00100000:3.0:1787604251.512451:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316607104 00000100:00100000:3.0:1787604251.512504:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787604251.512514:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f84115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+16:21917:x1874438316607104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787604251.512529:0:21915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604251.512549:0:21915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a080031c00/0x6c241a9cc41dd3f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd3eb expref: -99 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604251.512573:0:21915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a080031c00/0x6c241a9cc41dd3f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd3eb expref: 17 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604251.512583:0:21915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a080031c00/0x6c241a9cc41dd3f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd3eb expref: 17 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604251.512593:0:21915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a080031c00, rc 0) 00000100:00100000:3.0:1787604251.512640:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f84115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+17:21917:x1874438316607104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604251.512674:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787604251.513277:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7273100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316607104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787604251.513296:0:21917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3200/0x6c241a9cc41dd3eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd3f2 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604251.513305:0:21917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3200/0x6c241a9cc41dd3eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd3f2 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604251.513373:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7273100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316607232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787604251.513405:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604251.513446:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09f89b69900 going to sleep for 11 seconds 00000100:00100000:2.0:1787604251.513447:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316607232 00000100:00100000:2.0:1787604251.513454:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316607232 00000100:00100000:2.0:1787604251.513491:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787604251.513505:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f84116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+17:21917:x1874438316607232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787604251.513787:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f84116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+17:21917:x1874438316607232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 281us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604251.513794:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787604251.513817:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7273100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316607232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787604251.513844:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7273100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316607360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787604251.513880:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604251.513907:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09f89b69900 going to sleep for 11 seconds 00000100:00100000:0.0:1787604251.513945:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316607360 00000100:00100000:0.0:1787604251.513950:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316607360 00000100:00100000:2.0:1787604251.513984:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787604251.513993:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f84114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+17:21917:x1874438316607360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787604251.514144:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f84114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+17:21917:x1874438316607360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604251.514152:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787604251.514182:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7273100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316607360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787604251.518225:0:23029:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787604251.518350:0:21917:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787604251.518383:0:21917:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787604251.518394:0:21917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3200/0x6c241a9cc41dd3eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd3f2 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604251.518405:0:21917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3200/0x6c241a9cc41dd3eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd3f2 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604251.518414:0:21917:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787604251.518416:0:21917:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0a0bc52f000 from 13 10000000:01000000:2.0:1787604251.518419:0:21917:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787604251.518455:0:21917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ec00/0x6c241a9cc41dd3f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604251.518463:0:21917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ec00/0x6c241a9cc41dd3f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604251.518473:0:21917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ec00/0x6c241a9cc41dd3f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604251.518513:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316607488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787604251.518576:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604251.518621:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a085475480 going to sleep for 11 seconds 00000100:00100000:0.0:1787604251.519491:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316607488 00000100:00100000:0.0:1787604251.519502:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316607488 00000100:00100000:0.0:1787604251.519561:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787604251.519571:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f84115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+17:21917:x1874438316607488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787604251.519593:0:21915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604251.519608:0:21915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09f89d23000/0x6c241a9cc41dd400 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd3f9 expref: -99 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604251.519633:0:21915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09f89d23000/0x6c241a9cc41dd400 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd3f9 expref: 18 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604251.519643:0:21915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09f89d23000/0x6c241a9cc41dd400 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd3f9 expref: 18 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604251.519653:0:21915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09f89d23000, rc 0) 00000100:00100000:0.0:1787604251.519910:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f84115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:21917:x1874438316607488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 339us (1332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604251.519918:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787604251.520011:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316607488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787604251.520029:0:21917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ec00/0x6c241a9cc41dd3f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd400 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604251.520038:0:21917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ec00/0x6c241a9cc41dd3f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd400 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604251.520110:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316607616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787604251.520139:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604251.520167:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a085475480 going to sleep for 11 seconds 00000100:00100000:3.0:1787604251.520212:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316607616 00000100:00100000:3.0:1787604251.520217:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316607616 00000100:00100000:3.0:1787604251.520250:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787604251.520257:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f84114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:21917:x1874438316607616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787604251.520518:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f84114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:21917:x1874438316607616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604251.520526:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787604251.520901:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316607616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787604251.520932:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316607744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787604251.520973:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604251.521039:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08569a480 going to sleep for 11 seconds 00000100:00100000:2.0:1787604251.523245:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316607744 00000100:00100000:2.0:1787604251.523259:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316607744 00000100:00100000:3.0:1787604251.528724:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787604251.528739:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f84116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:21917:x1874438316607744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787604251.528974:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f84116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:21917:x1874438316607744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 238us (7999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604251.529128:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316607744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787604251.529449:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000040:00080000:1.0:1787604251.530415:0:23032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787604251.530781:0:21917:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787604251.530804:0:21917:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787604251.530815:0:21917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ec00/0x6c241a9cc41dd3f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd400 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604251.530825:0:21917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ec00/0x6c241a9cc41dd3f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd400 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604252.090532:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604252.163917:0:3449:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787604242/real 1787604242] req@ffffa0a084f13480 x1874438316601344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787604252 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604252.163944:0:3449:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0a084f13480 x1874438316601344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787604252 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604252.163954:0:3449:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787604242/real 1787604242] req@ffffa0a0b7273480 x1874438316601216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787604252 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604252.163965:0:3449:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0a0b7273480 x1874438316601216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787604252 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787604252.163984:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f889a1000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787604252.164032:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787604252.164047:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3449:1874438316601344:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787604252.164053:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f891cb000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787604252.164128:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787604252.164132:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787604252.164140:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787604252.164143:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787604252.164161:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787604252.164164:0:15520:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787604252.164167:0:15520:0:(import.c:65:import_set_state_nolock()) ffffa09f891cb000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787604252.164172:0:15520:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 622 00000100:00080000:0.0:1787604252.164177:0:15520:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787604252.164183:0:15520:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffffa09f891cb000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1787604252.164204:0:15520:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a084f11c00 x1874438316608384/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787604252.164213:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787604252.164216:0:15520:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787604252.164217:0:15520:0:(import.c:65:import_set_state_nolock()) ffffa09f889a1000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787604252.164221:0:15520:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 622 00000100:00100000:2.0:1787604252.164223:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316608256:0@lo:400:kworker.0 00000100:00080000:0.0:1787604252.164223:0:15520:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787604252.164227:0:15520:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffffa09f889a1000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1787604252.164239:0:15520:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a084f13800 x1874438316608512/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787604252.164261:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3451:1874438316608128:0@lo:400:kworker.0 00000100:00100000:2.0:1787604252.164286:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604252.164286:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604252.164312:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3450:1874438316608000:0@lo:400:kworker.0 00000100:00080000:3.0:1787604252.164330:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787604252.164334:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3449:1874438316601216:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787604252.164354:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3449:1874438316608384:0@lo:8:kworker.0 00000100:00100000:2.0:1787604252.164543:0:3452:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787604252.164556:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3452:1874438316607872:0@lo:400:kworker.0 00000100:00100000:2.0:1787604252.164587:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604252.164603:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316608128 00000100:00100000:0.0:1787604252.164610:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316608128 00000100:00100000:2.0:1787604252.164611:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3452:1874438316608640:0@lo:400:kworker.0 00000100:00100000:2.0:1787604252.164631:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604252.164647:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316608640 00000100:00100000:0.0:1787604252.164649:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316608640 00000100:00100000:2.0:1787604252.164653:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316607872 00000100:00100000:2.0:1787604252.164667:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316607872 00000100:00100000:0.0:1787604252.164679:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787604252.164713:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787604252.164717:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a084f12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3451:x1874438316608128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604252.164719:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bced3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:3452:x1874438316607872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604252.164768:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a084f12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3451:x1874438316608128:12345-0@lo:400:kworker.0 Request processed in 52us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604252.164775:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787604252.164792:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787604252.164798:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3452:x1874438316608640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604252.164826:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3452:x1874438316608640:12345-0@lo:400:kworker.0 Request processed in 28us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604252.164829:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bced3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:3452:x1874438316607872:12345-0@lo:400:kworker.0 Request processed in 110us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604252.164832:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787604252.164835:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1787604252.164861:0:3451:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0a084f11880 x1874438316608128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787604252.164864:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3452:1874438316607872:0@lo:400:kworker.0 00000100:00100000:0.0:1787604252.164871:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3451:1874438316608128:0@lo:400:kworker.0 00010000:00080000:2.0:1787604252.164873:0:3452:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0a084f11500 x1874438316608640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787604252.164880:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3452:1874438316608640:0@lo:400:kworker.0 00000400:00000100:3.0:1787604252.166172:0:3449:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874438316608384 offset 0 length 520: 4 00000100:00100000:3.0:1787604252.166215:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3449:1874438316608512:0@lo:8:kworker.0 00000400:00000100:3.0:1787604252.166262:0:3449:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874438316608512 offset 0 length 520: 4 00000100:00100000:3.0:1787604252.166306:0:22565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316608256 00000100:00100000:3.0:1787604252.166311:0:22565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316608256 00000100:00100000:3.0:1787604252.166462:0:22565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787604252.166472:0:22565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3452:x1874438316608256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604252.166579:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604252.166643:0:22565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3452:x1874438316608256:12345-0@lo:400:kworker.0 Request processed in 173us (2357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604252.166652:0:22565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787604252.166893:0:22565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316608000 00000100:00100000:3.0:1787604252.166897:0:22565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316608000 00000100:00100000:3.0:1787604252.166918:0:22565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787604252.166925:0:22565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3450:x1874438316608000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604252.166966:0:22565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3450:x1874438316608000:12345-0@lo:400:kworker.0 Request processed in 43us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604252.166972:0:22565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1787604252.167004:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787604252.167009:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787604252.167020:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787604252.167024:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787604252.167062:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316608256:0@lo:400:kworker.0 00000100:00100000:0.0:1787604252.167230:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3450:1874438316608000:0@lo:400:kworker.0 00000040:00080000:1.0:1787604252.411260:0:21956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787604253.110823:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604253.176117:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3450:1874438316608768:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787604253.176193:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604253.176251:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787604253.176259:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316608896:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787604253.176284:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604253.176340:0:21926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316608768 00000100:00100000:0.0:1787604253.176347:0:21926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316608768 00000100:00100000:0.0:1787604253.176385:0:21926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316608896 00000100:00100000:0.0:1787604253.176388:0:21926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316608896 00000100:00100000:0.0:1787604253.176403:0:21926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787604253.176411:0:21926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a084f10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3450:x1874438316608768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787604253.176447:0:21926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787604253.176501:0:21926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a084f10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3450:x1874438316608768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604253.176509:0:21926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787604253.176524:0:21926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787604253.176531:0:21926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a084f11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316608896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787604253.176549:0:21926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787604253.176576:0:21926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a084f11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316608896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 46us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604253.176582:0:21926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787604253.176909:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316608896:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787604253.176924:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3450:1874438316608768:0@lo:41:osp-pre-1-0.0 00000001:00100000:3.0:1787604253.280204:0:7237:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1787604254.135316:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787604254.204573:0:22580:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787604255.158026:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604255.221934:0:3449:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787604240/real 1787604240] req@ffffa0a0a009f800 x1874438316599296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787604255 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604255.221980:0:3449:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0a0a009f800 x1874438316599296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787604255 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604255.221992:0:3449:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787604240/real 1787604240] req@ffffa0a0a009df80 x1874438316599424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787604255 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604255.222003:0:3449:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0a0a009df80 x1874438316599424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787604255 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787604255.222026:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f884b0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787604255.222051:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787604255.222056:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316599296:0@lo:8:kworker.0 00000100:00080000:3.0:1787604255.222062:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa0a0bca77000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787604255.222068:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787604255.222071:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316599424:0@lo:8:kworker.0 00000100:00080000:2.0:1787604255.222287:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787604255.222292:0:15520:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787604255.222295:0:15520:0:(import.c:65:import_set_state_nolock()) ffffa09f884b0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787604255.222301:0:15520:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 620 00000100:00080000:2.0:1787604255.222307:0:15520:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787604255.222315:0:15520:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa09f884b0000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1787604255.222337:0:15520:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa09f89d90380 x1874438316609280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787604255.222353:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787604255.222377:0:15520:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787604255.222379:0:15520:0:(import.c:65:import_set_state_nolock()) ffffa0a0bca77000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787604255.222383:0:15520:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 620 00000100:00080000:2.0:1787604255.222386:0:15520:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787604255.222390:0:15520:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0a0bca77000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1787604255.222404:0:15520:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa09f89d91880 x1874438316609408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787604255.222450:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787604255.222453:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787604255.222456:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787604255.222470:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787604255.222499:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3453:1874438316609152:0@lo:400:kworker.0 00000100:00100000:2.0:1787604255.222580:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604255.222649:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787604255.222655:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3453:1874438316609024:0@lo:400:kworker.0 00000100:00100000:2.0:1787604255.222711:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604255.222736:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3453:1874438316609792:0@lo:400:kworker.0 00000100:00100000:2.0:1787604255.222763:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604255.222791:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3450:1874438316609536:0@lo:400:kworker.0 00000100:00100000:2.0:1787604255.222821:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604255.222842:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787604255.222847:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316609664:0@lo:400:kworker.0 00000100:00100000:2.0:1787604255.222870:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604255.222920:0:21926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316609152 00000100:00100000:2.0:1787604255.222936:0:21926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316609152 00000100:00100000:2.0:1787604255.222990:0:21926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316609664 00000100:00100000:2.0:1787604255.222993:0:21926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316609664 00000100:00100000:2.0:1787604255.223014:0:21926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787604255.223023:0:21926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1874438316609152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604255.223086:0:21926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1874438316609152:12345-0@lo:400:kworker.0 Request processed in 63us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604255.223094:0:21926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787604255.223113:0:21926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787604255.223120:0:21926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316609664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604255.223153:0:21926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316609664:12345-0@lo:400:kworker.0 Request processed in 34us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604255.223158:0:21926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787604255.223177:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316609024 00000100:00100000:2.0:1787604255.223181:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316609024 00000100:00100000:2.0:1787604255.223206:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787604255.223213:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bced3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:3453:x1874438316609024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604255.223241:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bced3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:3453:x1874438316609024:12345-0@lo:400:kworker.0 Request processed in 29us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604255.223246:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787604255.223278:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316609792 00000100:00100000:2.0:1787604255.223282:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316609792 00000100:00100000:2.0:1787604255.223308:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316609536 00000100:00100000:2.0:1787604255.223311:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316609536 00000100:00100000:2.0:1787604255.223324:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787604255.223329:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3453:x1874438316609792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604255.223358:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3453:x1874438316609792:12345-0@lo:400:kworker.0 Request processed in 28us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604255.223374:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787604255.223385:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787604255.223391:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1874438316609536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604255.223418:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1874438316609536:12345-0@lo:400:kworker.0 Request processed in 27us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604255.223425:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787604255.223481:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316609664:0@lo:400:kworker.0 00010000:00080000:2.0:1787604255.223494:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa09f89d90e00 x1874438316609536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787604255.223502:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3450:1874438316609536:0@lo:400:kworker.0 00000100:00100000:2.0:1787604255.223526:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316609280:0@lo:8:kworker.0 00000400:00000100:2.0:1787604255.223568:0:3449:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874438316609280 offset 0 length 520: 4 00000100:00100000:2.0:1787604255.223584:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316609408:0@lo:8:kworker.0 00000400:00000100:2.0:1787604255.223606:0:3449:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874438316609408 offset 0 length 520: 4 00000100:00100000:2.0:1787604255.223649:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3453:1874438316609024:0@lo:400:kworker.0 00010000:00080000:2.0:1787604255.223662:0:3453:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa09f89d90000 x1874438316609792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787604255.223672:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3453:1874438316609792:0@lo:400:kworker.0 00000100:00100000:2.0:1787604255.223682:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3453:1874438316609152:0@lo:400:kworker.0 00000020:01000004:0.0:1787604256.006179:0:23232:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787604256.006183:0:23232:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1787604256.006298:0:23232:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa0a0aef9a000 00000020:01000004:0.0:1787604256.006312:0:23232:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787604256.006326:0:23232:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787604256.006339:0:23232:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffffa0a0bcfe0000) 00000020:00000080:0.0:1787604256.006354:0:23232:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787604256.067448:0:23232:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787604256.068017:0:23232:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787604256.069339:0:23232:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787604256.069916:0:23232:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787604256.070347:0:23232:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:2.0:1787604256.071001:0:23232:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 497: rc = 0 00100000:10000000:2.0:1787604256.071473:0:23232:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 497: rc = 0 00100000:10000000:2.0:1787604256.071854:0:23232:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 497: rc = 0 00100000:10000000:2.0:1787604256.072907:0:23232:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 647: rc = 0 00100000:10000000:2.0:1787604256.073309:0:23232:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 647: rc = 0 00100000:10000000:2.0:1787604256.073853:0:23232:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 647: rc = 0 00100000:10000000:2.0:1787604256.074271:0:23232:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 647: rc = 0 00100000:10000000:2.0:1787604256.074805:0:23232:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 647: rc = 0 00100000:10000000:2.0:1787604256.075124:0:23232:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 647: rc = 0 00000020:00000080:2.0:1787604256.076815:0:23232:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787604256.076829:0:23232:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787604256.076841:0:23232:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6c241a9cc41dd40e 00000020:01000004:2.0:1787604256.076849:0:23232:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787604256.076868:0:23232:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.116@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787604256.076871:0:23232:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787604256.076877:0:23232:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787604256.076881:0:23232:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787604256.076893:0:23232:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffffa09f820819b8) 00000020:00000080:2.0:1787604256.076904:0:23232:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1787604256.078207:0:23232:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787604256.078377:0:23232:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787604256.078383:0:23232:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787604256.079959:0:23232:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787604256.079969:0:23232:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787604256.080336:0:23232:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787604256.080342:0:23232:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787604256.083734:0:23232:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787604256.083899:0:23232:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787604256.083905:0:23232:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787604256.090998:0:23232:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787604256.091012:0:23232:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787604256.135093:0:23232:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787604256.135895:0:23232:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787604256.135907:0:23232:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787604256.138366:0:23232:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787604256.138377:0:23232:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787604256.139362:0:23232:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787604256.139371:0:23232:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787604256.149929:0:23232:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787604256.150136:0:23232:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787604256.150143:0:23232:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787604256.153413:0:23232:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787604256.153425:0:23232:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:1.0:1787604256.181896:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604256.226965:0:23232:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787604256.227346:0:23232:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787604256.227353:0:23232:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787604256.232302:0:23232:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787604256.232316:0:23232:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787604256.251242:0:23232:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787604256.251268:0:23232:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787604256.251275:0:23232:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.116@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787604256.280838:0:23232:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.116@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787604256.280885:0:23232:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.116@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787604256.280893:0:23232:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787604256.280895:0:23232:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787604256.280897:0:23232:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787604256.280898:0:23232:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787604256.280899:0:23232:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787604256.280900:0:23232:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787604256.280902:0:23232:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787604256.280903:0:23232:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787604256.280905:0:23232:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787604256.280908:0:23232:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787604256.280911:0:23232:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787604256.280912:0:23232:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787604256.280913:0:23232:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787604256.280914:0:23232:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787604256.280915:0:23232:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787604256.280916:0:23232:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787604256.280917:0:23232:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787604256.280918:0:23232:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787604256.280919:0:23232:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787604256.280944:0:23232:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787604256.280964:0:23232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316609920:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787604256.281028:0:23232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604256.281378:0:23232:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a085b95540 going to sleep for 11 seconds 00000100:00100000:2.0:1787604256.284512:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316609920 00000100:00100000:2.0:1787604256.284527:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316609920 00000100:00100000:2.0:1787604256.284821:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787604256.284832:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:23232:x1874438316609920:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787604256.284885:0:21914:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787604256.284889:0:21914:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787604256.284893:0:21914:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787604256.291439:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:23232:x1874438316609920:12345-0@lo:253:mount.lustre.0 Request processed in 6601us (10402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604256.291461:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787604256.291609:0:23232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316609920:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787604256.291624:0:23232:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787604256.291636:0:23232:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787604256.291638:0:23232:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787604256.291653:0:23232:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787604256.291654:0:23232:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787604256.291655:0:23232:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787604256.291657:0:23232:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787604256.291658:0:23232:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787604256.291660:0:23232:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787604256.291661:0:23232:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787604256.291681:0:23232:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0a0aef9a000 from lustre-OST0000 10000000:01000000:0.0:1787604256.291891:0:23232:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787604256.291895:0:23232:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787604256.291903:0:23232:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa0a0906a3370 local copy 00010000:00010000:0.0:1787604256.291913:0:23232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa09f89d23a00/0x6c241a9cc41dd1c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd1d0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604256.292236:0:23232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f12300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316610048:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787604256.292278:0:23232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604256.292318:0:23232:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a098791840 going to sleep for 11 seconds 00000100:00100000:3.0:1787604256.292378:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316610048 00000100:00100000:3.0:1787604256.292385:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316610048 00000100:00100000:3.0:1787604256.292431:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787604256.292440:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:23232:x1874438316610048:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787604256.292621:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:23232:x1874438316610048:12345-0@lo:501:mount.lustre.0 Request processed in 182us (342us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787604256.292639:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787604256.292808:0:23232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f12300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316610048:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787604256.292822:0:23232:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787604256.292977:0:23232:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787604256.292985:0:23232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa09f89d23a00/0x6c241a9cc41dd1c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd1d0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604256.293001:0:23232:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa09f89d23a00/0x6c241a9cc41dd1c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd1d0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787604256.293022:0:23232:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0a0aef9a000 10000000:01000000:1.0:1787604256.293027:0:23232:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787604256.293032:0:23232:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787604256.293034:0:23232:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787604256.293038:0:23232:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787604256.293041:0:23232:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787604256.293074:0:23232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0813d2a00/0x6c241a9cc41dd41c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604256.293083:0:23232:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0a0813d2a00/0x6c241a9cc41dd41c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604256.293092:0:23232:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0a0813d2a00/0x6c241a9cc41dd41c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604256.293105:0:23232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7270000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316610176:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787604256.293133:0:23232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604256.293156:0:23232:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a082fffc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787604256.293326:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316610176 00000100:00100000:3.0:1787604256.293331:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316610176 00000100:00100000:3.0:1787604256.293350:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787604256.293357:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+18:23232:x1874438316610176:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787604256.293374:0:21913:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604256.293387:0:21913:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a080031200/0x6c241a9cc41dd423 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd41c expref: -99 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604256.293409:0:21913:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a080031200/0x6c241a9cc41dd423 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd41c expref: 19 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604256.293418:0:21913:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a080031200/0x6c241a9cc41dd423 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd41c expref: 19 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604256.293427:0:21913:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a080031200, rc 0) 00000100:00100000:3.0:1787604256.293455:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+19:23232:x1874438316610176:12345-0@lo:101:mount.lustre.0 Request processed in 99us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604256.293461:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787604256.293608:0:23232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7270000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316610176:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787604256.293621:0:23232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0a0813d2a00/0x6c241a9cc41dd41c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd423 expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604256.293638:0:23232:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0a0813d2a00/0x6c241a9cc41dd41c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd423 expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787604256.294465:0:23232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1787604256.297426:0:23232:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787604256.297763:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1787604256.297806:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1787604256.297838:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1787604256.297882:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1787604256.297919:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1787604256.297955:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1787604256.298003:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1787604256.298042:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1787604256.298397:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1787604256.298453:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1787604256.298487:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1787604256.298527:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1787604256.298839:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1787604256.298848:0:23232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1787604256.298935:0:23232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7270000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316610304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787604256.298999:0:23232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604256.300186:0:23232:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a082fffcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787604256.302172:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316610304 00000100:00100000:3.0:1787604256.302184:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316610304 00000100:00100000:3.0:1787604256.302248:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787604256.302258:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82187850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+19:23232:x1874438316610304:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787604256.303204:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82187850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+19:23232:x1874438316610304:12345-0@lo:501:mount.lustre.0 Request processed in 946us (4202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604256.303214:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787604256.304767:0:23232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7270000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316610304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787604256.304823:0:23232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7270000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316610432:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787604256.304888:0:23232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604256.304973:0:23232:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a082fffcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787604256.311679:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316610432 00000100:00100000:0.0:1787604256.311751:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316610432 00000100:00100000:0.0:1787604256.314427:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787604256.314450:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82184c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+19:23232:x1874438316610432:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787604256.314912:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82184c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+19:23232:x1874438316610432:12345-0@lo:503:mount.lustre.0 Request processed in 471us (10021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604256.314920:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787604256.315044:0:23232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7270000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316610432:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787604256.315614:0:23232:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787604256.315737:0:23232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316610560:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787604256.315789:0:23232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604256.318966:0:23232:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a084d29780 going to sleep for 11 seconds 00000100:00100000:1.0:1787604256.319221:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316610560 00000100:00100000:1.0:1787604256.319230:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316610560 00000100:00100000:1.0:1787604256.319280:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787604256.319290:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82185450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+19:23232:x1874438316610560:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787604256.319614:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82185450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+19:23232:x1874438316610560:12345-0@lo:502:mount.lustre.0 Request processed in 325us (3824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604256.319622:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787604256.319917:0:23232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316610560:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787604256.320185:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1787604256.320237:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1787604256.320268:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1787604256.320315:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1787604256.320353:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1787604256.320388:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1787604256.320454:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1787604256.320500:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1787604256.320535:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1787604256.320601:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1787604256.320669:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1787604256.320766:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1787604256.320806:0:23232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316610688:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787604256.320856:0:23232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604256.320888:0:23232:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a084d29780 going to sleep for 11 seconds 00000100:00100000:1.0:1787604256.321254:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316610688 00000100:00100000:1.0:1787604256.321261:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316610688 00000100:00100000:1.0:1787604256.321291:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787604256.321299:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82186050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+19:23232:x1874438316610688:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787604256.321463:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82186050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+19:23232:x1874438316610688:12345-0@lo:502:mount.lustre.0 Request processed in 164us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604256.321471:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787604256.324657:0:23232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316610688:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787604256.324841:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1787604256.324859:0:23232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1787604256.326866:0:23246:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787604256.326876:0:23246:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787604256.326882:0:23246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604256.326884:0:23246:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787604256.326890:0:23246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787604256.326905:0:23246:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffffa09f89e519b8) 00000020:00000080:1.0:1787604256.326927:0:23246:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787604256.326933:0:23246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787604256.326994:0:23246:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0a0aef9a000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787604256.327002:0:23246:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787604256.327025:0:23246:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6c241a9cc41dd431 00010000:00010000:1.0:1787604256.338882:0:23246:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1787604256.339410:0:23246:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:1.0:1787604256.348997:0:23246:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:2.0:1787604256.365386:0:23246:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787604256.365397:0:23246:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787604256.365403:0:23246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604256.365405:0:23246:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787604256.365408:0:23246:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787604256.365411:0:23246:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1787604256.365413:0:23246:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787604256.365414:0:23246:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787604256.365416:0:23246:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787604256.365418:0:23246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604256.365419:0:23246:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787604256.365421:0:23246:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787604256.365424:0:23246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604256.365425:0:23246:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787604256.365428:0:23246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787604256.365429:0:23246:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787604256.365432:0:23246:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787604256.365434:0:23246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604256.365435:0:23246:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787604256.365437:0:23246:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787604256.365446:0:23246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604256.365447:0:23246:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787604256.365451:0:23246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787604256.365519:0:23246:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787604256.365523:0:23246:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787604256.365525:0:23246:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787604256.365528:0:23246:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1787604256.374449:0:23232:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1787604256.375151:0:23232:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787604256.375373:0:23232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0813d2a00/0x6c241a9cc41dd41c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd423 expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604256.375386:0:23232:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0a0813d2a00/0x6c241a9cc41dd41c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd423 expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787604256.375410:0:23232:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0a0aef9a000 from 1 10000000:01000000:0.0:1787604256.375413:0:23232:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787604256.375448:0:23232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd438 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604256.375456:0:23232:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd438 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604256.375467:0:23232:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd438 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604256.375805:0:23232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f12300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316610816:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787604256.375891:0:23232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604256.375970:0:23232:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a083715240 going to sleep for 11 seconds 00000100:00100000:1.0:1787604256.376404:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316610816 00000100:00100000:1.0:1787604256.376412:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316610816 00000100:00100000:1.0:1787604256.376517:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787604256.376528:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82185850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+19:23232:x1874438316610816:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787604256.376552:0:21914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604256.376566:0:21914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a0813d3000/0x6c241a9cc41dd43f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd438 expref: -99 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604256.376606:0:21914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a0813d3000/0x6c241a9cc41dd43f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd438 expref: 20 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604256.376615:0:21914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a0813d3000/0x6c241a9cc41dd43f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd438 expref: 20 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604256.376623:0:21914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a0813d3000, rc 0) 00000100:00100000:1.0:1787604256.376716:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82185850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+20:23232:x1874438316610816:12345-0@lo:101:mount.lustre.0 Request processed in 190us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604256.376723:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787604256.376825:0:23232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f12300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316610816:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787604256.376840:0:23232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd438 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd43f expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604256.376848:0:23232:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd438 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd43f expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787604256.377344:0:23232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1787604256.377837:0:23232:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787604256.378057:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1787604256.378103:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1787604256.378153:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1787604256.378192:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1787604256.378223:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1787604256.378266:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1787604256.378304:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1787604256.378336:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1787604256.378380:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1787604256.378437:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1787604256.378470:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1787604256.378538:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1787604256.378546:0:23232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1787604256.378615:0:23232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316610944:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787604256.378683:0:23232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604256.392948:0:23232:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a084d29540 going to sleep for 11 seconds 00000100:00100000:0.0:1787604256.396961:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316610944 00000100:00100000:0.0:1787604256.396977:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316610944 00000100:00100000:2.0:1787604256.397357:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787604256.397370:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82187050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+20:23232:x1874438316610944:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787604256.397722:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82187050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+20:23232:x1874438316610944:12345-0@lo:501:mount.lustre.0 Request processed in 354us (19038us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604256.397731:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787604256.398035:0:23232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316610944:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787604256.398086:0:23232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7271500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316611072:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787604256.398137:0:23232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604256.398178:0:23232:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a082fffc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787604256.398377:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316611072 00000100:00100000:3.0:1787604256.398383:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316611072 00000100:00100000:3.0:1787604256.398406:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787604256.398413:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82186850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+20:23232:x1874438316611072:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787604256.404886:0:23232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7271500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316611072:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787604256.405454:0:23232:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787604256.405532:0:23232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7271500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316611200:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787604256.408979:0:23232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604256.409024:0:23232:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09f8a7b09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787604256.409734:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316611200 00000100:00100000:0.0:1787604256.409743:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316611200 00000100:00100000:0.0:1787604256.409805:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787604256.409816:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82184850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:23232:x1874438316611200:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787604256.410055:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82184850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:23232:x1874438316611200:12345-0@lo:502:mount.lustre.0 Request processed in 240us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604256.410063:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787604256.410674:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82186850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+20:23232:x1874438316611072:12345-0@lo:503:mount.lustre.0 Request processed in 12259us (12535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604256.410719:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787604256.410987:0:23232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7271500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316611200:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787604256.411258:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1787604256.411310:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1787604256.411371:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1787604256.411409:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1787604256.411440:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1787604256.412932:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1787604256.413029:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1787604256.413068:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1787604256.413127:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1787604256.413164:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1787604256.413200:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1787604256.413243:0:23232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7271500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316611328:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787604256.413313:0:23232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604256.413359:0:23232:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a082fffc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787604256.413983:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316611328 00000100:00100000:0.0:1787604256.413991:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316611328 00000100:00100000:0.0:1787604256.414029:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787604256.414038:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82187c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+20:23232:x1874438316611328:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787604256.414246:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82187c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+20:23232:x1874438316611328:12345-0@lo:502:mount.lustre.0 Request processed in 208us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604256.414254:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787604256.414578:0:23232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7271500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316611328:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787604256.414967:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1787604256.414981:0:23232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787604256.429043:0:23250:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787604256.429055:0:23250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604256.429058:0:23250:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787604256.429064:0:23250:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0a0aef9a000 00000020:00000080:1.0:1787604256.429067:0:23250:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787604256.429073:0:23250:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787604256.429076:0:23250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604256.429078:0:23250:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787604256.429080:0:23250:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787604256.429083:0:23250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604256.429084:0:23250:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787604256.429088:0:23250:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0a0aef9a000 00000020:00000080:1.0:1787604256.429090:0:23250:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787604256.429156:0:23250:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787604256.429160:0:23250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604256.429162:0:23250:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787604256.429165:0:23250:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787604256.429180:0:23250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604256.429181:0:23250:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787604256.429186:0:23250:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0a0aef9a000 00000020:00000080:1.0:1787604256.429188:0:23250:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787604256.429207:0:23250:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787604256.429210:0:23250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604256.429212:0:23250:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787604256.429215:0:23250:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787604256.429217:0:23250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604256.429219:0:23250:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787604256.429222:0:23250:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0a0aef9a000 00000020:00000080:1.0:1787604256.429224:0:23250:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787604256.429260:0:23250:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787604256.429264:0:23250:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604256.429265:0:23250:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787604256.429268:0:23250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1787604256.432903:0:23232:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787604256.432943:0:23232:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787604256.432963:0:23232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd438 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd43f expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604256.432977:0:23232:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd438 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd43f expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604256.433025:0:23232:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787604256.433029:0:23232:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0a0aef9a000 10000000:01000000:2.0:1787604256.433031:0:23232:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0a0aef9a000 10000000:01000000:2.0:1787604256.433035:0:23232:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787604256.433041:0:23232:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0a0aef9a000 from 1 10000000:01000000:2.0:1787604256.433044:0:23232:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787604256.433078:0:23232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ea00/0x6c241a9cc41dd446 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604256.433087:0:23232:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ea00/0x6c241a9cc41dd446 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604256.433097:0:23232:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ea00/0x6c241a9cc41dd446 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604256.433120:0:23232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316611456:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787604256.433195:0:23232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604256.433239:0:23232:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a084d29540 going to sleep for 11 seconds 00000100:00100000:3.0:1787604256.436806:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316611456 00000100:00100000:3.0:1787604256.436817:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316611456 00000100:00100000:3.0:1787604256.436873:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787604256.436883:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82187450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+20:23232:x1874438316611456:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787604256.436897:0:21913:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604256.436913:0:21913:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a080030600/0x6c241a9cc41dd44d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd446 expref: -99 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604256.436941:0:21913:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a080030600/0x6c241a9cc41dd44d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd446 expref: 21 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604256.436952:0:21913:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a080030600/0x6c241a9cc41dd44d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd446 expref: 21 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604256.436962:0:21913:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a080030600, rc 0) 00000100:00100000:3.0:1787604256.437033:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82187450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:23232:x1874438316611456:12345-0@lo:101:mount.lustre.0 Request processed in 151us (3838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604256.437041:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787604256.437425:0:23232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316611456:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787604256.437443:0:23232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ea00/0x6c241a9cc41dd446 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd44d expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604256.437453:0:23232:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ea00/0x6c241a9cc41dd446 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd44d expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787604256.438158:0:23232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1787604256.438454:0:23232:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787604256.438720:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1787604256.438763:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1787604256.438794:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1787604256.438837:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1787604256.438871:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1787604256.438915:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1787604256.438949:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1787604256.438980:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1787604256.439027:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1787604256.439065:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1787604256.439098:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1787604256.439145:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1787604256.439202:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1787604256.439239:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1787604256.439286:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1787604256.439325:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1787604256.439361:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1787604256.439413:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1787604256.439450:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1787604256.439484:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1787604256.439546:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1787604256.439584:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1787604256.439620:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1787604256.439678:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1787604256.439743:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1787604256.439777:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1787604256.439826:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1787604256.439861:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1787604256.439908:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1787604256.439958:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1787604256.439995:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1787604256.440028:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1787604256.440065:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1787604256.440113:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1787604256.440149:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1787604256.440198:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1787604256.440233:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1787604256.440261:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1787604256.440303:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1787604256.440338:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1787604256.440371:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1787604256.440404:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1787604256.440452:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1787604256.440489:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1787604256.440542:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1787604256.440592:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1787604256.457368:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1787604256.457474:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1787604256.457616:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1787604256.457672:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1787604256.457760:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1787604256.457769:0:23232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1787604256.457866:0:23232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316611584:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787604256.457942:0:23232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604256.457987:0:23232:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a084d29540 going to sleep for 11 seconds 00000100:00100000:1.0:1787604256.458230:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316611584 00000100:00100000:1.0:1787604256.458238:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316611584 00000100:00100000:1.0:1787604256.458279:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787604256.458289:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82186c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:23232:x1874438316611584:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787604256.458522:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82186c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:23232:x1874438316611584:12345-0@lo:501:mount.lustre.0 Request processed in 233us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604256.458530:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787604256.464878:0:23232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316611584:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787604256.464940:0:23232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316611712:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787604256.465018:0:23232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604256.465058:0:23232:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a084d29540 going to sleep for 11 seconds 00000100:00100000:0.0:1787604256.476115:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316611712 00000100:00100000:0.0:1787604256.476130:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316611712 00000100:00100000:0.0:1787604256.476188:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787604256.476198:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82184050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:23232:x1874438316611712:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787604256.477389:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82184050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:23232:x1874438316611712:12345-0@lo:503:mount.lustre.0 Request processed in 1187us (12366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604256.477399:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787604256.477922:0:23232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316611712:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787604256.478430:0:23232:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787604256.478510:0:23232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316611840:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787604256.478585:0:23232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604256.478635:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316611840 00000100:00100000:2.0:1787604256.478641:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316611840 00000100:00100000:2.0:1787604256.478682:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787604256.478720:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:23232:x1874438316611840:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787604256.478972:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:23232:x1874438316611840:12345-0@lo:502:mount.lustre.0 Request processed in 254us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604256.478979:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787604256.479021:0:23232:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08551d900 going to sleep for 11 seconds 00000100:00100000:2.0:1787604256.479034:0:23232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316611840:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787604256.479225:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1787604256.479269:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1787604256.479305:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1787604256.479353:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1787604256.479389:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1787604256.479454:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1787604256.479489:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1787604256.479536:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1787604256.479585:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1787604256.479621:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1787604256.479667:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1787604256.479744:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1787604256.479778:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1787604256.479810:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1787604256.479858:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1787604256.479893:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1787604256.479926:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1787604256.479974:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1787604256.480010:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1787604256.480042:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1787604256.480086:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1787604256.480139:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1787604256.480170:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1787604256.480220:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1787604256.480258:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1787604256.480291:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1787604256.480349:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1787604256.480386:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1787604256.480417:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1787604256.480461:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1787604256.480498:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1787604256.480532:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1787604256.480567:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1787604256.480614:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1787604256.492866:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1787604256.492966:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1787604256.493004:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1787604256.493055:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1787604256.493105:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1787604256.493140:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1787604256.493183:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1787604256.493216:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1787604256.493259:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1787604256.493291:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1787604256.493323:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1787604256.493367:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1787604256.493398:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1787604256.493424:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1787604256.494455:0:23232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316611968:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787604256.494897:0:23232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604256.494942:0:23232:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08551d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787604256.495037:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316611968 00000100:00100000:0.0:1787604256.495045:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316611968 00000100:00100000:0.0:1787604256.495095:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787604256.495104:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:23232:x1874438316611968:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787604256.495340:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:23232:x1874438316611968:12345-0@lo:502:mount.lustre.0 Request processed in 236us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604256.495347:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787604256.496862:0:23232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316611968:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787604256.497021:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1787604256.497068:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1787604256.497103:0:23232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316612096:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787604256.497161:0:23232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604256.497192:0:23232:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a085b95540 going to sleep for 11 seconds 00000100:00100000:0.0:1787604256.497267:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316612096 00000100:00100000:0.0:1787604256.497272:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316612096 00000100:00100000:0.0:1787604256.497308:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787604256.497316:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:23232:x1874438316612096:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787604256.497486:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:23232:x1874438316612096:12345-0@lo:502:mount.lustre.0 Request processed in 161us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604256.497494:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787604256.497828:0:23232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316612096:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787604256.497927:0:23232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1787604256.497939:0:23232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787604256.518875:0:23255:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787604256.518890:0:23255:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffffa0a0832899b8) 00000020:00000080:2.0:1787604256.518912:0:23255:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1787604256.518996:0:23255:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0a0aef9a000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787604256.519000:0:23255:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0a0aef9a000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787604256.519003:0:23255:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0a0aef9a000 3 00010000:00080000:2.0:1787604256.519033:0:23255:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa09f8834c800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.116@tcp at head 00010000:00010000:2.0:1787604256.520748:0:23255:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1787604256.520955:0:23255:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787604256.520992:0:23255:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787604256.521004:0:23255:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x6c241a9cc41dd45b 00000100:00080000:2.0:1787604256.521013:0:23255:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787604256.521019:0:23255:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa09f8834c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1787604256.521051:0:23255:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa09f89d92a00 x1874438316612224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787604256.521081:0:23255:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787604256.521314:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787604256.521318:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787604256.521321:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787604256.521324:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787604256.521349:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787604256.521352:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787604256.521355:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787604256.521357:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787604256.521388:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3452:1874438316612736:0@lo:400:kworker.0 00000100:00100000:3.0:1787604256.521454:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604256.521488:0:3452:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787604256.521493:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3452:1874438316612352:0@lo:400:kworker.0 00000100:00100000:3.0:1787604256.521517:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604256.521544:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3450:1874438316612480:0@lo:400:kworker.0 00000100:00100000:3.0:1787604256.521565:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604256.521583:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787604256.521588:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316612608:0@lo:400:kworker.0 00000100:00100000:3.0:1787604256.521610:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604256.521658:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316612736 00000100:00100000:3.0:1787604256.521664:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316612736 00000100:00100000:3.0:1787604256.521731:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316612480 00000100:00100000:3.0:1787604256.521735:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316612480 00000100:00100000:3.0:1787604256.521763:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787604256.521770:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a009df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3452:x1874438316612736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604256.521817:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a009df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3452:x1874438316612736:12345-0@lo:400:kworker.0 Request processed in 47us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604256.521823:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787604256.521838:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787604256.521844:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a009e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1874438316612480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604256.521873:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a009e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1874438316612480:12345-0@lo:400:kworker.0 Request processed in 29us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604256.521878:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787604256.521902:0:21926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316612352 00000100:00100000:3.0:1787604256.521906:0:21926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316612352 00000100:00100000:3.0:1787604256.521926:0:21926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316612608 00000100:00100000:3.0:1787604256.521930:0:21926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316612608 00000100:00100000:3.0:1787604256.521941:0:21926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787604256.521946:0:21926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a009c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3452:x1874438316612352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604256.521976:0:21926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a009c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3452:x1874438316612352:12345-0@lo:400:kworker.0 Request processed in 29us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604256.521981:0:21926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787604256.521993:0:21926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787604256.521998:0:21926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090b7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316612608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604256.522026:0:21926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090b7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316612608:12345-0@lo:400:kworker.0 Request processed in 27us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604256.522031:0:21926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787604256.522074:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316612608:0@lo:400:kworker.0 00010000:00080000:3.0:1787604256.522085:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0a0a009d180 x1874438316612480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604256.522101:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3450:1874438316612480:0@lo:400:kworker.0 00000100:00100000:3.0:1787604256.522135:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3452:1874438316612352:0@lo:400:kworker.0 00010000:00080000:3.0:1787604256.522145:0:3452:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0a0a009e300 x1874438316612736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604256.522154:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3452:1874438316612736:0@lo:400:kworker.0 00000100:00100000:0.0:1787604256.523604:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3449:1874438316612224:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787604256.523677:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604256.527661:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316612224 00000100:00100000:3.0:1787604256.527675:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316612224 00000100:00100000:3.0:1787604256.527749:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787604256.527757:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a084f12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3449:x1874438316612224:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787604256.527784:0:21920:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 636 last 0 00000020:00000080:3.0:1787604256.527820:0:21920:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x6c241a9cc41dd462 00000004:00100000:3.0:1787604256.527836:0:21920:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787604256.527872:0:21920:0:(import.c:65:import_set_state_nolock()) ffffa09f88834000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787604256.527956:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a084f12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3449:x1874438316612224:12345-0@lo:38:llog_process_th.0 Request processed in 198us (4278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604256.527964:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787604256.528016:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa09f89d92a00 x1874438316612224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787604266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604256.528027:0:3449:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787604256.528035:0:3449:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1787604256.528042:0:3449:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787604256.528045:0:3449:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787604256.528047:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f8834c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787604256.528067:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3449:1874438316612224:0@lo:38:llog_process_th.0 00000020:01000004:2.0:1787604256.530838:0:23255:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787604256.530854:0:23255:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffffa0a08328b370) 00000020:00000080:2.0:1787604256.530883:0:23255:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1787604256.530976:0:23255:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0a0aef9a000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787604256.530980:0:23255:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0a0aef9a000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787604256.530982:0:23255:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0a0aef9a000 3 00010000:00080000:2.0:1787604256.531010:0:23255:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa09f8834a800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.116@tcp at head 00010000:00010000:2.0:1787604256.548645:0:23255:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1787604256.549713:0:23255:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787604256.549753:0:23255:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787604256.549764:0:23255:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x6c241a9cc41dd470 00000100:00080000:2.0:1787604256.549773:0:23255:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787604256.549779:0:23255:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffffa09f8834a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1787604256.549811:0:23255:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa09f89d90e00 x1874438316612864/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787604256.549837:0:23255:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787604256.552882:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787604256.552889:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787604256.552892:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787604256.552895:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787604256.552899:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787604256.552901:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787604256.552903:0:15520:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787604256.552906:0:15520:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787604256.553039:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3449:1874438316612864:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787604256.553112:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604256.553225:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316612864 00000100:00100000:2.0:1787604256.553234:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316612864 00000100:00100000:2.0:1787604256.553303:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787604256.553319:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a084f11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3449:x1874438316612864:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787604256.553345:0:21922:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 636 last 0 00000020:00000080:2.0:1787604256.553380:0:21922:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x6c241a9cc41dd477 00000004:00100000:2.0:1787604256.553394:0:21922:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787604256.553437:0:21922:0:(import.c:65:import_set_state_nolock()) ffffa09f8214e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787604256.553558:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a084f11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3449:x1874438316612864:12345-0@lo:38:llog_process_th.0 Request processed in 238us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604256.553565:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:3.0:1787604256.561081:0:23255:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1787604256.561194:0:23232:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787604256.561222:0:23232:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787604256.561236:0:23232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ea00/0x6c241a9cc41dd446 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd44d expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604256.561247:0:23232:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ea00/0x6c241a9cc41dd446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd44d expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787604256.561292:0:23232:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787604256.561294:0:23232:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787604256.561295:0:23232:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787604256.561297:0:23232:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787604256.561298:0:23232:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787604256.561299:0:23232:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787604256.561300:0:23232:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787604256.561302:0:23232:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787604256.561303:0:23232:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787604256.561307:0:23232:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1787604256.561309:0:23232:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787604256.561310:0:23232:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787604256.561311:0:23232:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787604256.561312:0:23232:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787604256.561313:0:23232:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787604256.561313:0:23232:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787604256.561314:0:23232:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787604256.561315:0:23232:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787604256.561316:0:23232:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787604256.561339:0:23232:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787604256.561357:0:23232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a090b7b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316612992:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787604256.561423:0:23232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604256.561449:0:23232:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a085b95540 going to sleep for 11 seconds 00010000:00080000:0.0:1787604256.561586:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa09f89d90e00 x1874438316612864/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787604266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604256.561598:0:3449:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787604256.561606:0:3449:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1787604256.561613:0:3449:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787604256.561618:0:3449:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787604256.561622:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f8834a800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787604256.561643:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3449:1874438316612864:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787604256.561835:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316612992 00000100:00100000:3.0:1787604256.561848:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316612992 00000100:00100000:3.0:1787604256.561895:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787604256.561904:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:23232:x1874438316612992:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787604256.561941:0:21913:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787604256.561953:0:21913:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787604256.645308:0:21913:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787604256.645337:0:21913:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787604256.645903:0:21936:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787604256.645912:0:21936:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787604256.645943:0:21936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd47e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604256.645967:0:21936:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0a0813d2200/0x6c241a9cc41dd3c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd3c1 expref: 21 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604256.645975:0:21936:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0a0c207ca00/0x6c241a9cc41dd3d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd3cf expref: 21 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604256.645984:0:21936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd47e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604256.646053:0:21936:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0a0c207ca00/0x6c241a9cc41dd3d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c241a9cc41dd3cf expref: 21 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604256.646090:0:21936:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0a0c207ca00/0x6c241a9cc41dd3d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c241a9cc41dd3cf expref: 21 pid: 21913 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604256.646107:0:21936:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f10a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21936:1874438316613120:0@lo:104: 00000100:00100000:0.0:1787604256.646193:0:21936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787604256.646264:0:21936:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0a0813d2200/0x6c241a9cc41dd3c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c241a9cc41dd3c1 expref: 21 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604256.646273:0:21936:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0a0813d2200/0x6c241a9cc41dd3c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c241a9cc41dd3c1 expref: 21 pid: 21915 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604256.646275:0:21904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316613120 00000100:00100000:0.0:1787604256.646281:0:21936:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f12300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21936:1874438316613248:0@lo:104: 00000100:00100000:1.0:1787604256.646285:0:21904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316613120 00000100:00100000:0.0:1787604256.646307:0:21936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604256.646332:0:21936:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09f81b41c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787604256.646341:0:21904:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787604256.646351:0:21904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316613248 00000100:00100000:1.0:1787604256.646354:0:21904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316613248 00000100:00100000:1.0:1787604256.646371:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787604256.646391:0:21904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a084f13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+4:21936:x1874438316613120:12345-0@lo:104: 00010000:00010000:1.0:1787604256.646407:0:21904:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f400/0x6c241a9cc41dd3cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c241a9cc41dd3d6 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604256.646474:0:21904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787604256.646481:0:21904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a084f13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+4:21936:x1874438316613120:12345-0@lo:104: Request processed in 93us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604256.646489:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787604256.646510:0:21904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787604256.646516:0:21904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a086c02850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+3:21936:x1874438316613248:12345-0@lo:104: 00010000:00010000:1.0:1787604256.646524:0:21904:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e800/0x6c241a9cc41dd3c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c241a9cc41dd3c8 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604256.646557:0:21904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787604256.646562:0:21904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a086c02850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+3:21936:x1874438316613248:12345-0@lo:104: Request processed in 46us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604256.646568:0:21904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787604256.646611:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787604256.646618:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f400/0x6c241a9cc41dd3cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c241a9cc41dd3d6 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604256.646637:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc44f400 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:1.0:1787604256.646642:0:21909:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f400/0x6c241a9cc41dd3cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c241a9cc41dd3d6 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604256.646652:0:21909:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f400/0x6c241a9cc41dd3cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c241a9cc41dd3d6 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787604256.646661:0:21909:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f400/0x6c241a9cc41dd3cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c241a9cc41dd3d6 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787604256.646677:0:21909:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787604256.646734:0:21909:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f400/0x6c241a9cc41dd3cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd3d6 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604256.646742:0:21909:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787604256.646774:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f400/0x6c241a9cc41dd3cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd3d6 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604256.646781:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f400/0x6c241a9cc41dd3cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd3d6 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604256.646795:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787604256.646798:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e800/0x6c241a9cc41dd3c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c241a9cc41dd3c8 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604256.646803:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc44e800 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:1.0:1787604256.646806:0:21909:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e800/0x6c241a9cc41dd3c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c241a9cc41dd3c8 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604256.646811:0:21909:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e800/0x6c241a9cc41dd3c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c241a9cc41dd3c8 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787604256.646817:0:21909:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e800/0x6c241a9cc41dd3c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c241a9cc41dd3c8 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787604256.646833:0:21909:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787604256.646846:0:21909:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e800/0x6c241a9cc41dd3c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd3c8 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604256.646852:0:21909:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787604256.646875:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e800/0x6c241a9cc41dd3c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd3c8 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604256.646882:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e800/0x6c241a9cc41dd3c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd3c8 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604256.646897:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604256.646898:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604256.646900:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604256.646907:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604256.646923:0:3452:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787604256.646936:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7271880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3452:1874438316613376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787604256.646969:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604256.647003:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3450:1874438316613504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787604256.647042:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604256.647203:0:21936:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f10a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21936:1874438316613120:0@lo:104: 00000100:00100000:0.0:1787604256.647214:0:21936:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f12300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21936:1874438316613248:0@lo:104: 00010000:00010000:0.0:1787604256.647239:0:21936:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd47e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604256.648444:0:21905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316613376 00000100:00100000:1.0:1787604256.648456:0:21905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316613376 00010000:00010000:1.0:1787604256.648489:0:21905:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0a0c207ca00/0x6c241a9cc41dd3d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c241a9cc41dd3cf expref: 22 pid: 21913 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604256.649336:0:21905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316613504 00000100:00100000:1.0:1787604256.649345:0:21905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316613504 00010000:00010000:1.0:1787604256.649368:0:21905:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0a0813d2200/0x6c241a9cc41dd3c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c241a9cc41dd3c1 expref: 23 pid: 21915 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604256.653577:0:21906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787604256.653598:0:21906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7271500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+23:3452:x1874438316613376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787604256.653622:0:21906:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787604256.653646:0:21906:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0a0c207ca00/0x6c241a9cc41dd3d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c241a9cc41dd3cf expref: 23 pid: 21913 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604256.653665:0:21906:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0a0c207ca00/0x6c241a9cc41dd3d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c241a9cc41dd3cf expref: 23 pid: 21913 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604256.653704:0:21906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0c207ca00/0x6c241a9cc41dd3d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c241a9cc41dd3cf expref: 23 pid: 21913 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604256.653725:0:21906:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787604256.653838:0:21906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7271500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+22:3452:x1874438316613376:12345-0@lo:103:ldlm_bl.0 Request processed in 247us (6866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604256.653847:0:21906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787604256.653884:0:21906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787604256.653892:0:21906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c01c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:3450:x1874438316613504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787604256.653901:0:21906:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787604256.653927:0:21906:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0a0813d2200/0x6c241a9cc41dd3c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c241a9cc41dd3c1 expref: 21 pid: 21915 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604256.653936:0:21906:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0a0813d2200/0x6c241a9cc41dd3c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c241a9cc41dd3c1 expref: 21 pid: 21915 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604256.653946:0:21906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0813d2200/0x6c241a9cc41dd3c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c241a9cc41dd3c1 expref: 21 pid: 21915 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604256.653958:0:21906:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd47e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604256.653967:0:21906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd47e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787604256.653984:0:21906:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.018282278s 00010000:00010000:2.0:1787604256.653990:0:21906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd47e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604256.653997:0:21906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd47e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604256.654004:0:21906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd47e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604256.654010:0:21906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd47e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604256.654017:0:21906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09f89d22000 already unused, calling callback (ffffffffc175e230) 00010000:00010000:2.0:1787604256.654022:0:21906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd47e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604256.654042:0:21906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd47e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604256.654065:0:21906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd47e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604256.654077:0:21906:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787604256.654112:0:21906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c01c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+20:3450:x1874438316613504:12345-0@lo:103:ldlm_bl.0 Request processed in 220us (7068us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604256.654118:0:21906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787604256.654653:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3450:1874438316613504:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787604256.654725:0:21936:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd47e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604256.654735:0:21936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd47e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604256.654743:0:21936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09f89d22000/0x6c241a9cc41dd47e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604256.655219:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7271880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3452:1874438316613376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787604256.677146:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+19:23232:x1874438316612992:12345-0@lo:253:mount.lustre.0 Request processed in 115230us (115708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604256.677228:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787604256.677367:0:23232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a090b7b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23232:1874438316612992:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787604256.677387:0:23232:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787604256.677391:0:23232:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787604256.677393:0:23232:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787604256.677395:0:23232:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787604256.677396:0:23232:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787604256.677397:0:23232:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787604256.677399:0:23232:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787604256.677400:0:23232:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787604256.677402:0:23232:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787604256.677404:0:23232:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787604256.677421:0:23232:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787604256.680309:0:23232:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787604256.680512:0:23232:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787604256.680749:0:23232:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787604256.681592:0:23232:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787604256.681832:0:23232:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787604256.682945:0:23232:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787604256.684555:0:23232:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1787604256.782597:0:23232:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787604256.782611:0:23232:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787604256.782675:0:23232:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787604256.782788:0:23232:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.116@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787604256.782809:0:23232:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787604256.782845:0:23232:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787604257.207609:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604258.231570:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604258.294291:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787604258.294313:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a090b7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3453:1874438316613760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787604258.294394:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604258.294455:0:21926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316613760 00000100:00100000:3.0:1787604258.294462:0:21926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316613760 00000100:00100000:3.0:1787604258.294781:0:21926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787604258.294791:0:21926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1874438316613760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787604258.294909:0:21926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787604258.294995:0:21926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1874438316613760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 205us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604258.295002:0:21926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787604258.295420:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7273800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316613632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787604258.295459:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604258.299544:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316613632 00000100:00100000:3.0:1787604258.299559:0:21925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316613632 00000100:00100000:3.0:1787604258.299610:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787604258.299629:0:21925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a084f12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316613632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787604258.299670:0:21925:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787604258.299776:0:21925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a084f12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316613632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 149us (4316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604258.299784:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787604258.299854:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7273800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316613632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787604258.308354:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a090b7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3453:1874438316613760:0@lo:41:osp-pre-1-0.0 10000000:01000000:1.0:1787604258.424193:0:21917:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787604258.424200:0:21917:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa09f891cd000 from 13 10000000:01000000:1.0:1787604258.424206:0:21917:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787604258.424254:0:21917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3c00/0x6c241a9cc41dd485 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604258.424266:0:21917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3c00/0x6c241a9cc41dd485 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604258.424278:0:21917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3c00/0x6c241a9cc41dd485 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604258.424304:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7273800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316613888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787604258.424380:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604258.424428:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0904cca80 going to sleep for 11 seconds 00000100:00100000:0.0:1787604258.424628:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316613888 00000100:00100000:0.0:1787604258.424635:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316613888 00000100:00100000:0.0:1787604258.424725:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787604258.424735:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+19:21917:x1874438316613888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787604258.424760:0:21914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604258.424774:0:21914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09f89d23c00/0x6c241a9cc41dd48c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd485 expref: -99 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604258.424797:0:21914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09f89d23c00/0x6c241a9cc41dd48c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd485 expref: 20 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604258.424807:0:21914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09f89d23c00/0x6c241a9cc41dd48c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd485 expref: 20 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604258.424816:0:21914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09f89d23c00, rc 0) 00000100:00100000:0.0:1787604258.424858:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+20:21917:x1874438316613888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604258.424864:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787604258.425095:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7273800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316613888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787604258.425109:0:21917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3c00/0x6c241a9cc41dd485 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd48c expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604258.425118:0:21917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3c00/0x6c241a9cc41dd485 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd48c expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604258.425169:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a090b78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316614016:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787604258.425204:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604258.425227:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0897c5900 going to sleep for 11 seconds 00000100:00100000:3.0:1787604258.425239:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316614016 00000100:00100000:3.0:1787604258.425243:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316614016 00000100:00100000:3.0:1787604258.425268:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787604258.425275:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+20:21917:x1874438316614016:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787604258.425288:0:21913:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787604258.425303:0:21913:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787604258.425306:0:21913:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1787604258.425399:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+20:21917:x1874438316614016:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604258.425406:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787604258.425449:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a090b78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316614016:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787604258.425516:0:21917:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787604258.425524:0:21917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3c00/0x6c241a9cc41dd485 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd48c expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604258.425533:0:21917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3c00/0x6c241a9cc41dd485 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd48c expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787604258.425542:0:21917:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787604258.425544:0:21917:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0a0bc52f000 from 13 10000000:01000000:3.0:1787604258.425546:0:21917:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787604258.425563:0:21917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a080030000/0x6c241a9cc41dd493 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604258.425571:0:21917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0a080030000/0x6c241a9cc41dd493 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604258.425589:0:21917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0a080030000/0x6c241a9cc41dd493 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604258.425602:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a090b78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316614144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787604258.425638:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604258.425665:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0897c5900 going to sleep for 11 seconds 00000100:00100000:3.0:1787604258.425677:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316614144 00000100:00100000:3.0:1787604258.425680:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316614144 00000100:00100000:3.0:1787604258.425722:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787604258.425728:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+20:21917:x1874438316614144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787604258.425736:0:21913:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604258.425745:0:21913:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a080030a00/0x6c241a9cc41dd49a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd493 expref: -99 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604258.425760:0:21913:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a080030a00/0x6c241a9cc41dd49a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd493 expref: 21 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604258.425769:0:21913:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a080030a00/0x6c241a9cc41dd49a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd493 expref: 21 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604258.425775:0:21913:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a080030a00, rc 0) 00000100:00100000:3.0:1787604258.425803:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:21917:x1874438316614144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604258.425808:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787604258.425836:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a090b78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316614144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787604258.425846:0:21917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0a080030000/0x6c241a9cc41dd493 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd49a expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604258.425859:0:21917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0a080030000/0x6c241a9cc41dd493 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd49a expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604258.425896:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a090b78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316614272:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787604258.425925:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604258.425937:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0897c5900 going to sleep for 11 seconds 00000100:00100000:3.0:1787604258.425947:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316614272 00000100:00100000:3.0:1787604258.425950:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316614272 00000100:00100000:3.0:1787604258.425968:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787604258.425973:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:21917:x1874438316614272:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787604258.425982:0:21913:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787604258.425991:0:21913:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787604258.425994:0:21913:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1787604258.426051:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:21917:x1874438316614272:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 77us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604258.426057:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787604258.426085:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a090b78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316614272:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787604258.426121:0:21917:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787604258.426127:0:21917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a080030000/0x6c241a9cc41dd493 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd49a expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604258.426135:0:21917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0a080030000/0x6c241a9cc41dd493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd49a expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604259.253947:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604260.279635:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604261.306949:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787604261.877891:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787604261.877898:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787604261.877900:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787604261.877903:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787604261.877920:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787604261.877922:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787604261.877931:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787604261.877935:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787604261.877978:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3450:1874438316614528:0@lo:400:kworker.0 00000100:00100000:2.0:1787604261.878042:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604261.878087:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3450:1874438316615040:0@lo:400:kworker.0 00000100:00100000:2.0:1787604261.878115:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604261.878138:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787604261.878144:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3450:1874438316614656:0@lo:400:kworker.0 00000100:00100000:2.0:1787604261.878164:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604261.878190:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3450:1874438316615168:0@lo:400:kworker.0 00000100:00100000:2.0:1787604261.878212:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604261.878239:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316615040 00000100:00100000:2.0:1787604261.878246:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316615040 00000100:00100000:2.0:1787604261.878287:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316614656 00000100:00100000:2.0:1787604261.878290:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316614656 00000100:00100000:2.0:1787604261.878300:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316615168 00000100:00100000:2.0:1787604261.878302:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316615168 00000100:00100000:2.0:1787604261.878318:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787604261.878327:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0c06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3450:x1874438316615040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604261.878373:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0c06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3450:x1874438316615040:12345-0@lo:400:kworker.0 Request processed in 47us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604261.878380:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787604261.878395:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787604261.878400:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0c04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1874438316614656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604261.878434:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0c04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3450:x1874438316614656:12345-0@lo:400:kworker.0 Request processed in 33us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604261.878445:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787604261.878459:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787604261.878465:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0c07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3450:x1874438316615168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604261.878513:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0c07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3450:x1874438316615168:12345-0@lo:400:kworker.0 Request processed in 48us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604261.878518:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787604261.878553:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09f89d90e00 x1874438316614656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787604261.878567:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3450:1874438316614656:0@lo:400:kworker.0 00010000:00080000:2.0:1787604261.878578:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0a0c0c04380 x1874438316615168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787604261.878585:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3450:1874438316615168:0@lo:400:kworker.0 00010000:00080000:2.0:1787604261.878607:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09f89d93800 x1874438316615040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787604261.878614:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3450:1874438316615040:0@lo:400:kworker.0 00000100:00100000:1.0:1787604261.878871:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3453:1874438316614400:0@lo:400:kworker.0 00000100:00100000:1.0:1787604261.878910:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604261.878937:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3453:1874438316614912:0@lo:400:kworker.0 00000100:00100000:1.0:1787604261.878958:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604261.878978:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787604261.878984:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316614784:0@lo:400:kworker.0 00000100:00100000:1.0:1787604261.879007:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604261.879035:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316614400 00000100:00100000:1.0:1787604261.879039:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316614400 00000100:00100000:1.0:1787604261.879067:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787604261.879074:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:3453:x1874438316614400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604261.879116:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:3453:x1874438316614400:12345-0@lo:400:kworker.0 Request processed in 42us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604261.879122:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787604261.879148:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316614528 00000100:00100000:1.0:1787604261.879153:0:21925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316614528 00000100:00100000:1.0:1787604261.879174:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316614784 00000100:00100000:1.0:1787604261.879177:0:21925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316614784 00000100:00100000:1.0:1787604261.879188:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787604261.879193:0:21925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0c05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3450:x1874438316614528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604261.879228:0:21925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0c05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3450:x1874438316614528:12345-0@lo:400:kworker.0 Request processed in 35us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604261.879235:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787604261.879247:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787604261.879253:0:21925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316614784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604261.879279:0:21925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316614784:12345-0@lo:400:kworker.0 Request processed in 26us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604261.879291:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787604261.879322:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316614784:0@lo:400:kworker.0 00000100:00100000:1.0:1787604261.879330:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3453:1874438316614400:0@lo:400:kworker.0 00000100:00100000:0.0:1787604261.880869:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316614912 00000100:00100000:0.0:1787604261.880880:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316614912 00000100:00100000:0.0:1787604261.880919:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787604261.880928:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3453:x1874438316614912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604261.881003:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3453:x1874438316614912:12345-0@lo:400:kworker.0 Request processed in 76us (2043us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604261.881009:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1787604261.881041:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787604261.881046:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787604261.883779:0:3453:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa09f89d90000 x1874438316614912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604261.883808:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3453:1874438316614912:0@lo:400:kworker.0 00000100:00100000:3.0:1787604261.883857:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3450:1874438316614528:0@lo:400:kworker.0 00010000:00010000:1.0:1787604262.326135:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787604262.651195:0:21956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787604263.354759:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604263.414820:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787604263.414968:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a090b78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3453:1874438316615296:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787604263.415040:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604263.420797:0:3452:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787604263.420820:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7271f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316615424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787604263.420892:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604263.420938:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316615296 00000100:00100000:1.0:1787604263.420946:0:21925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316615296 00000100:00100000:1.0:1787604263.421005:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316615424 00000100:00100000:1.0:1787604263.421009:0:21925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316615424 00000100:00100000:1.0:1787604263.421024:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787604263.421051:0:21925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3453:x1874438316615296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787604263.421091:0:21925:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787604263.421133:0:21925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3453:x1874438316615296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (6093us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604263.421141:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787604263.421159:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787604263.421165:0:21925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3452:x1874438316615424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787604263.421184:0:21925:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787604263.421422:0:21925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3452:x1874438316615424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 256us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604263.421428:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787604263.421477:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a090b78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3453:1874438316615296:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787604263.422669:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7271f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316615424:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1787604264.156273:0:23602:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787604264.374656:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787604264.438660:0:22580:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787604265.399723:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604266.421798:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787604266.998842:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787604266.998850:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787604266.998853:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787604266.998857:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787604266.998887:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787604266.998891:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787604266.998894:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787604266.998897:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787604266.998944:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a090b79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3450:1874438316615552:0@lo:400:kworker.0 00000100:00100000:3.0:1787604266.999039:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604266.999101:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a090b78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3450:1874438316616064:0@lo:400:kworker.0 00000100:00100000:3.0:1787604266.999132:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604266.999177:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787604266.999184:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a090b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3450:1874438316615680:0@lo:400:kworker.0 00000100:00100000:3.0:1787604266.999214:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604266.999235:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a090b79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3450:1874438316616192:0@lo:400:kworker.0 00000100:00100000:3.0:1787604266.999258:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604266.999302:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a090b79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3452:1874438316615808:0@lo:400:kworker.0 00000100:00100000:3.0:1787604266.999331:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604266.999349:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a090b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3452:1874438316616320:0@lo:400:kworker.0 00000100:00100000:3.0:1787604266.999377:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604266.999401:0:3452:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787604266.999406:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a090b7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316615936:0@lo:400:kworker.0 00000100:00100000:3.0:1787604266.999431:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604266.999472:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316615680 00000100:00100000:3.0:1787604266.999482:0:21925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316615680 00000100:00100000:3.0:1787604266.999538:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316615936 00000100:00100000:3.0:1787604266.999543:0:21925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316615936 00000100:00100000:3.0:1787604266.999574:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787604266.999585:0:21925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3450:x1874438316615680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604266.999655:0:21925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3450:x1874438316615680:12345-0@lo:400:kworker.0 Request processed in 71us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604266.999663:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787604266.999712:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787604266.999720:0:21925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3452:x1874438316615936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604266.999755:0:21925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3452:x1874438316615936:12345-0@lo:400:kworker.0 Request processed in 36us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604266.999762:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787604266.999797:0:21921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316616064 00000100:00100000:3.0:1787604266.999800:0:21921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316616064 00000100:00100000:3.0:1787604266.999819:0:21921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316616192 00000100:00100000:3.0:1787604266.999821:0:21921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316616192 00000100:00100000:3.0:1787604266.999846:0:21921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316615808 00000100:00100000:3.0:1787604266.999848:0:21921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316615808 00000100:00100000:3.0:1787604266.999860:0:21921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316616320 00000100:00100000:3.0:1787604266.999863:0:21921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316616320 00000100:00100000:3.0:1787604266.999880:0:21921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787604266.999886:0:21921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3450:x1874438316616064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604266.999922:0:21921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3450:x1874438316616064:12345-0@lo:400:kworker.0 Request processed in 35us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604266.999928:0:21921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787604266.999940:0:21921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787604266.999945:0:21921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090b78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3450:x1874438316616192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604266.999970:0:21921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090b78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3450:x1874438316616192:12345-0@lo:400:kworker.0 Request processed in 25us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604266.999975:0:21921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787604266.999985:0:21921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787604266.999991:0:21921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3452:x1874438316615808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604267.000016:0:21921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3452:x1874438316615808:12345-0@lo:400:kworker.0 Request processed in 25us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604267.000022:0:21921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787604267.000032:0:21921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787604267.000038:0:21921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3452:x1874438316616320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604267.000064:0:21921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3452:x1874438316616320:12345-0@lo:400:kworker.0 Request processed in 26us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604267.000081:0:21921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787604267.000468:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a090b7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316615936:0@lo:400:kworker.0 00010000:00080000:3.0:1787604267.000485:0:3452:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0a090b79c00 x1874438316615808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604267.000496:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a090b79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3452:1874438316615808:0@lo:400:kworker.0 00010000:00080000:3.0:1787604267.000507:0:3452:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0a090b78000 x1874438316616320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604267.000516:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a090b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3452:1874438316616320:0@lo:400:kworker.0 00000100:00100000:3.0:1787604267.000566:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a090b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3450:1874438316615680:0@lo:400:kworker.0 00010000:00080000:3.0:1787604267.000579:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0a090b79f80 x1874438316616192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604267.000587:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a090b79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3450:1874438316616192:0@lo:400:kworker.0 00010000:00080000:3.0:1787604267.000597:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0a090b78380 x1874438316616064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604267.000606:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a090b78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3450:1874438316616064:0@lo:400:kworker.0 00000100:00080000:0.0:1787604267.001434:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787604267.001441:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787604267.002054:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316615552 00000100:00100000:1.0:1787604267.002068:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316615552 00000100:00100000:1.0:1787604267.002342:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787604267.002355:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:3450:x1874438316615552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604267.002472:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:3450:x1874438316615552:12345-0@lo:400:kworker.0 Request processed in 119us (3433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604267.002481:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787604267.003121:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a090b79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3450:1874438316615552:0@lo:400:kworker.0 00010000:00010000:3.0:1787604267.446420:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604267.836608:0:3449:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787604252/real 1787604252] req@ffffa0a084f11c00 x1874438316608384/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787604267 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787604267.836651:0:3449:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0a084f11c00 x1874438316608384/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787604267 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787604267.836662:0:3449:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787604252/real 1787604252] req@ffffa0a084f13800 x1874438316608512/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787604267 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787604267.836740:0:3449:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0a084f13800 x1874438316608512/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787604267 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787604267.836766:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f891cb000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787604267.836790:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787604267.836795:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3449:1874438316608384:0@lo:8:kworker.0 00000100:00080000:2.0:1787604267.836801:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f889a1000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787604267.836806:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787604267.836810:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3449:1874438316608512:0@lo:8:kworker.0 00000100:00080000:3.0:1787604267.836902:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787604267.836909:0:492:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787604267.836912:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787604267.836924:0:492:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787604267.836927:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787604267.836930:0:492:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787604267.836934:0:492:0:(import.c:65:import_set_state_nolock()) ffffa09f891cb000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787604267.836939:0:492:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 632 00000100:00080000:3.0:1787604267.836945:0:492:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787604267.836953:0:492:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffffa09f891cb000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1787604267.836995:0:492:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a090b79880 x1874438316616448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787604267.837018:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787604267.837021:0:492:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787604267.837023:0:492:0:(import.c:65:import_set_state_nolock()) ffffa09f889a1000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787604267.837027:0:492:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 632 00000100:00080000:3.0:1787604267.837029:0:492:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787604267.837034:0:492:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffffa09f889a1000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1787604267.837045:0:492:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a090b78380 x1874438316616576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787604267.837100:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a090b79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3449:1874438316616448:0@lo:8:kworker.0 00000100:00100000:2.0:1787604267.837184:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604267.837238:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a090b78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3449:1874438316616576:0@lo:8:kworker.0 00000100:00100000:2.0:1787604267.837285:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604267.837352:0:23233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316616448 00000100:00100000:3.0:1787604267.837362:0:23233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316616448 00000100:00100000:3.0:1787604267.837400:0:23233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316616576 00000100:00100000:3.0:1787604267.837404:0:23233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316616576 00000100:00100000:3.0:1787604267.837418:0:23233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787604267.837427:0:23233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3449:x1874438316616448:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787604267.837463:0:23233:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 647 last 0 00000020:00000080:3.0:1787604267.837512:0:23233:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6c241a9cc41dd4a1 00002000:00100000:3.0:1787604267.837535:0:23233:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffffa09f81af4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1787604267.837540:0:23233:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1787604267.837543:0:23233:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787604267.838004:0:23233:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1787604267.838030:0:23233:0:(import.c:65:import_set_state_nolock()) ffffa09f81af6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787604267.838102:0:23233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3449:x1874438316616448:12345-0@lo:8:kworker.0 Request processed in 673us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604267.838111:0:23233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787604267.838134:0:23233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787604267.838140:0:23233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3449:x1874438316616576:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787604267.838155:0:23233:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1787604267.840683:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0a090b79880 x1874438316616448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787604287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787604267.840721:0:3449:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787604267.840734:0:3449:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1787604267.840745:0:3449:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787604267.840753:0:3449:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787604267.840757:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f891cb000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787604267.840777:0:3449:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787604267.840784:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a090b79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3449:1874438316616448:0@lo:8:kworker.0 00000004:00080000:1.0:1787604267.840922:0:22567:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787604267.840950:0:22567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7270000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22567:1874438316616832:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1787604267.841039:0:22567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604267.841075:0:22567:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0812ed9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787604267.841102:0:23235:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787604267.841110:0:23235:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787604267.844677:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7271500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316616704:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787604267.844797:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787604267.845781:0:22566:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787604267.846198:0:22566:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 647983510986ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787604267.846335:0:23236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316616704 00000100:00100000:1.0:1787604267.846346:0:23236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316616704 00000100:00100000:1.0:1787604267.846416:0:23236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787604267.846429:0:23236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0c05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3453:x1874438316616704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787604267.846473:0:23236:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787604267.846631:0:23236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0c05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3453:x1874438316616704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 204us (1833us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604267.846641:0:23236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787604267.846715:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787604267.846991:0:3453:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0a0b7271500 x1874438316616704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787604283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604267.847015:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7271500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316616704:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787604267.858786:0:23235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316616832 00000100:00100000:2.0:1787604267.858801:0:23235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316616832 00000100:00100000:2.0:1787604267.859865:0:23736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787604267.859880:0:23736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:22567:x1874438316616832:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:2.0:1787604267.873320:0:23736:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1787604267.873332:0:23736:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1787604267.873459:0:23736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:22567:x1874438316616832:12345-0@lo:7:osp-pre-0-1.0 Request processed in 13577us (32413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604267.873471:0:23736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787604267.873502:0:22567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0a0b7270000 x1874438316616832/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787604283 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604267.873520:0:22567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7270000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22567:1874438316616832:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1787604267.873538:0:22567:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:1.0:1787604267.873596:0:22567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7270000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22567:1874438316616960:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1787604267.873636:0:22567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604267.873661:0:22567:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0812ed9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787604267.875058:0:23235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316616960 00000100:00100000:2.0:1787604267.875071:0:23235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316616960 00000100:00100000:2.0:1787604267.875128:0:23235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787604267.875140:0:23235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:22567:x1874438316616960:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1787604267.875174:0:23235:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1787604267.875245:0:23235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:22567:x1874438316616960:12345-0@lo:5:osp-pre-0-1.0 Request processed in 106us (1607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604267.875253:0:23235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787604267.876059:0:22567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0a0b7270000 x1874438316616960/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787604283 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787604267.876075:0:22567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7270000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22567:1874438316616960:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1787604267.876090:0:22567:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1787604267.876138:0:22567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c04e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22567:1874438316617088:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1787604267.876181:0:22567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604267.876205:0:22567:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a082887600 going to sleep for 11 seconds 00000100:00100000:1.0:1787604267.878624:0:23234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316617088 00000100:00100000:1.0:1787604267.878638:0:23234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316617088 00000100:00100000:1.0:1787604267.878709:0:23234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787604267.878736:0:23234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:22567:x1874438316617088:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1787604267.878793:0:23234:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:2.0:1787604267.881571:0:23233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3449:x1874438316616576:12345-0@lo:8:kworker.0 Request processed in 43404us (44259us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787604267.881594:0:23233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787604267.881662:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f889a1000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787604267.881668:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787604267.881806:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a090b78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3449:1874438316616576:0@lo:8:kworker.0 00000100:00100000:1.0:1787604267.966471:0:23234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:22567:x1874438316617088:12345-0@lo:5:osp-pre-0-1.0 Request processed in 87727us (90277us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1787604267.966487:0:23234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787604267.970195:0:22567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0a0c0c04e00 x1874438316617088/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787604283 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604267.970225:0:22567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c04e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22567:1874438316617088:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1787604267.970250:0:22567:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1787604267.970315:0:22567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7270000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:22567:1874438316617216:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1787604267.972770:0:22567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604267.972818:0:22567:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0812ed9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787604267.972891:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316617216 00000100:00100000:1.0:1787604267.972901:0:21932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316617216 00000100:00100000:1.0:1787604267.973056:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787604267.973067:0:21932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:22567:x1874438316617216:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1787604267.973147:0:21932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:22567:x1874438316617216:12345-0@lo:900:osp-pre-0-1.0 Request processed in 80us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604267.973155:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787604267.973202:0:22567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0a0b7270000 x1874438316617216/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787604283 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604267.973216:0:22567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7270000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:22567:1874438316617216:0@lo:900:osp-pre-0-1.0 00000004:00080000:3.0:1787604268.013948:0:7237:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00010000:3.0:1787604268.469856:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604268.534385:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a090b79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3450:1874438316617344:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787604268.534480:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604268.534731:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316617344 00000100:00100000:2.0:1787604268.534741:0:21925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316617344 00000100:00100000:2.0:1787604268.534805:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787604268.534818:0:21925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a084f10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3450:x1874438316617344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787604268.534868:0:21925:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787604268.537797:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7270000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316617472:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787604268.537896:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604268.538607:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a090b79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3450:1874438316617344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787604268.538666:0:21925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a084f10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3450:x1874438316617344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3844us (4180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604268.538681:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787604268.540077:0:21926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316617472 00000100:00100000:3.0:1787604268.540088:0:21926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316617472 00000100:00100000:3.0:1787604268.540148:0:21926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787604268.540159:0:21926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316617472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787604268.540341:0:21926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787604268.540496:0:21926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316617472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 339us (2599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604268.540504:0:21926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787604268.540540:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7270000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316617472:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787604269.497012:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604270.519512:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604271.543652:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787604272.235917:0:8099:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:3.0:1787604272.235947:0:8099:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00010000:1.0:1787604272.568760:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787604272.703831:0:23954:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787604272.703835:0:23954:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787604272.703949:0:23954:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa09f82148800 00000020:01000004:2.0:1787604272.703962:0:23954:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787604272.703978:0:23954:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787604272.703991:0:23954:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffffa0a083288000) 00000020:00000080:2.0:1787604272.704007:0:23954:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787604272.724656:0:23954:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787604272.725030:0:23954:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1787604272.726054:0:23954:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787604272.726377:0:23954:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1787604272.726654:0:23954:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:0.0:1787604272.727201:0:23954:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 465: rc = 0 00100000:10000000:0.0:1787604272.727502:0:23954:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 465: rc = 0 00100000:10000000:0.0:1787604272.727616:0:23954:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 465: rc = 0 00100000:10000000:0.0:1787604272.728433:0:23954:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 775: rc = 0 00100000:10000000:0.0:1787604272.728776:0:23954:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 775: rc = 0 00100000:10000000:0.0:1787604272.729042:0:23954:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 775: rc = 0 00100000:10000000:0.0:1787604272.729405:0:23954:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 775: rc = 0 00100000:10000000:0.0:1787604272.729660:0:23954:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 775: rc = 0 00100000:10000000:0.0:1787604272.730098:0:23954:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 775: rc = 0 00000020:00000080:0.0:1787604272.730901:0:23954:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787604272.730916:0:23954:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787604272.730929:0:23954:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6c241a9cc41dd4af 00000020:01000004:0.0:1787604272.730937:0:23954:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1787604272.730960:0:23954:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.116@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787604272.730963:0:23954:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787604272.730969:0:23954:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787604272.730993:0:23954:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1787604272.730997:0:23954:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.116@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787604272.741240:0:23954:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.116@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787604272.741275:0:23954:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.116@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1787604272.741280:0:23954:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787604272.741282:0:23954:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787604272.741288:0:23954:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787604272.741290:0:23954:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787604272.741291:0:23954:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787604272.741292:0:23954:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787604272.741293:0:23954:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787604272.741295:0:23954:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787604272.741296:0:23954:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787604272.741301:0:23954:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1787604272.741303:0:23954:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787604272.741304:0:23954:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787604272.741305:0:23954:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787604272.741306:0:23954:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787604272.741307:0:23954:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787604272.741308:0:23954:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787604272.741309:0:23954:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787604272.741310:0:23954:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787604272.741311:0:23954:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787604272.741335:0:23954:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787604272.741356:0:23954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f13800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316617600:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787604272.741433:0:23954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604272.741489:0:23954:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a085489a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787604272.741526:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316617600 00000100:00100000:1.0:1787604272.741534:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316617600 00000100:00100000:1.0:1787604272.741861:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787604272.741873:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:23954:x1874438316617600:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787604272.741901:0:21915:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787604272.741904:0:21915:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1787604272.741909:0:21915:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787604272.747494:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:23954:x1874438316617600:12345-0@lo:253:mount.lustre.0 Request processed in 5614us (6051us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604272.747538:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787604272.747799:0:23954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f13800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316617600:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787604272.747817:0:23954:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787604272.747821:0:23954:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787604272.747823:0:23954:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787604272.747825:0:23954:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787604272.747826:0:23954:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787604272.747827:0:23954:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787604272.747829:0:23954:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787604272.747831:0:23954:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787604272.747832:0:23954:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787604272.747834:0:23954:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787604272.747856:0:23954:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa09f82148800 from lustre-OST0001 10000000:01000000:0.0:1787604272.747882:0:23954:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787604272.747886:0:23954:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787604272.747895:0:23954:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa0a0906a3370 local copy 00010000:00010000:0.0:1787604272.747907:0:23954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa09f89d23a00/0x6c241a9cc41dd1c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd1d0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604272.748474:0:23954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f13800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316617728:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787604272.748538:0:23954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604272.748581:0:23954:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a085489240 going to sleep for 11 seconds 00000100:00100000:1.0:1787604272.750268:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316617728 00000100:00100000:1.0:1787604272.750281:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316617728 00000100:00100000:1.0:1787604272.750352:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787604272.750362:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:23954:x1874438316617728:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787604272.750654:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:23954:x1874438316617728:12345-0@lo:501:mount.lustre.0 Request processed in 292us (2114us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787604272.750662:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787604272.750928:0:23954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f13800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316617728:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787604272.750950:0:23954:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787604272.751117:0:23954:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787604272.751125:0:23954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa09f89d23a00/0x6c241a9cc41dd1c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd1d0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604272.751136:0:23954:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa09f89d23a00/0x6c241a9cc41dd1c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd1d0 expref: -99 pid: 21902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604272.751172:0:23954:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa09f82148800 10000000:01000000:2.0:1787604272.751177:0:23954:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787604272.751183:0:23954:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787604272.751186:0:23954:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787604272.751190:0:23954:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787604272.751192:0:23954:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787604272.751221:0:23954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f000/0x6c241a9cc41dd4b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604272.751229:0:23954:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f000/0x6c241a9cc41dd4b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604272.751237:0:23954:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f000/0x6c241a9cc41dd4b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604272.751256:0:23954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c07b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316617856:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787604272.751360:0:23954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604272.751448:0:23954:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a083f45840 going to sleep for 11 seconds 00000100:00100000:3.0:1787604272.751568:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316617856 00000100:00100000:3.0:1787604272.751611:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316617856 00000100:00100000:3.0:1787604272.751705:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787604272.751714:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:23954:x1874438316617856:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787604272.751724:0:21915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604272.751736:0:21915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a080030800/0x6c241a9cc41dd4bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd4b6 expref: -99 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604272.751757:0:21915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a080030800/0x6c241a9cc41dd4bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd4b6 expref: 22 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604272.751766:0:21915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a080030800/0x6c241a9cc41dd4bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd4b6 expref: 22 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604272.751775:0:21915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a080030800, rc 0) 00000100:00100000:3.0:1787604272.751816:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+22:23954:x1874438316617856:12345-0@lo:101:mount.lustre.0 Request processed in 103us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604272.751822:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787604272.751887:0:23954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c07b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316617856:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787604272.751899:0:23954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f000/0x6c241a9cc41dd4b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd4bd expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604272.751908:0:23954:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f000/0x6c241a9cc41dd4b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd4bd expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787604272.752565:0:23954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1787604272.753442:0:23954:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787604272.753751:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1787604272.753807:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1787604272.753846:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1787604272.753898:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1787604272.753940:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1787604272.753978:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1787604272.754030:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1787604272.754070:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1787604272.754121:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1787604272.754183:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1787604272.754192:0:23954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1787604272.754263:0:23954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c07b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316617984:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787604272.754321:0:23954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604272.754873:0:23954:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a083f45d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787604272.754975:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316617984 00000100:00100000:1.0:1787604272.754983:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316617984 00000100:00100000:1.0:1787604272.755024:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787604272.755033:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+22:23954:x1874438316617984:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787604272.755547:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+22:23954:x1874438316617984:12345-0@lo:501:mount.lustre.0 Request processed in 514us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604272.755556:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787604272.755834:0:23954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c07b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316617984:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787604272.755880:0:23954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c07b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316618112:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787604272.755928:0:23954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604272.757963:0:23954:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a083f45d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787604272.761463:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316618112 00000100:00100000:3.0:1787604272.761480:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316618112 00000100:00100000:3.0:1787604272.761589:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787604272.761601:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+22:23954:x1874438316618112:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787604272.762032:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+22:23954:x1874438316618112:12345-0@lo:503:mount.lustre.0 Request processed in 432us (6102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604272.762040:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787604272.762153:0:23954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c07b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316618112:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787604272.763314:0:23954:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787604272.763397:0:23954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c07b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316618240:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787604272.763458:0:23954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604272.767937:0:23954:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a083f45d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787604272.768113:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316618240 00000100:00100000:1.0:1787604272.768123:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316618240 00000100:00100000:1.0:1787604272.768173:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787604272.768182:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a04cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+22:23954:x1874438316618240:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787604272.768511:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a04cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+22:23954:x1874438316618240:12345-0@lo:502:mount.lustre.0 Request processed in 329us (5051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604272.768530:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787604272.771784:0:23954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c07b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316618240:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787604272.772092:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1787604272.772175:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1787604272.772213:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1787604272.772279:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1787604272.772338:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1787604272.772374:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1787604272.772442:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1787604272.772486:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1787604272.772543:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1787604272.772587:0:23954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c07b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316618368:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787604272.772664:0:23954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604272.772730:0:23954:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a083f45d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787604272.774270:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316618368 00000100:00100000:1.0:1787604272.774281:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316618368 00000100:00100000:1.0:1787604272.774327:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787604272.774337:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a04ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+22:23954:x1874438316618368:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787604272.774596:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a04ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+22:23954:x1874438316618368:12345-0@lo:502:mount.lustre.0 Request processed in 260us (1931us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604272.774605:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787604272.774792:0:23954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c07b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316618368:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787604272.774891:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1787604272.774906:0:23954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1787604272.776201:0:23955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787604272.776211:0:23955:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787604272.776217:0:23955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604272.776220:0:23955:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787604272.776225:0:23955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787604272.776238:0:23955:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffffa09f89e53370) 00000020:00000080:1.0:1787604272.776273:0:23955:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787604272.776280:0:23955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787604272.776340:0:23955:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa09f82148800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787604272.776348:0:23955:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787604272.776354:0:23955:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6c241a9cc41dd4cb 00010000:00010000:1.0:1787604272.785371:0:23955:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1787604272.785914:0:23955:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:1.0:1787604272.791931:0:23955:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1787604272.793113:0:23955:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787604272.793123:0:23955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787604272.793128:0:23955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604272.793130:0:23955:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787604272.793136:0:23955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787604272.793146:0:23955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604272.793148:0:23955:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787604272.793151:0:23955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787604272.793153:0:23955:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787604272.793155:0:23955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787604272.793157:0:23955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604272.793159:0:23955:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787604272.793161:0:23955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787604272.793163:0:23955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604272.793164:0:23955:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787604272.793166:0:23955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787604272.793213:0:23955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787604272.793215:0:23955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787604272.793216:0:23955:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787604272.793219:0:23955:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:2.0:1787604272.801607:0:23954:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787604272.801650:0:23954:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787604272.801672:0:23954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f000/0x6c241a9cc41dd4b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd4bd expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604272.801703:0:23954:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44f000/0x6c241a9cc41dd4b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd4bd expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604272.801713:0:23954:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa09f82148800 from 1 10000000:01000000:2.0:1787604272.801716:0:23954:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787604272.801756:0:23954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e000/0x6c241a9cc41dd4d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604272.801764:0:23954:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e000/0x6c241a9cc41dd4d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604272.801774:0:23954:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e000/0x6c241a9cc41dd4d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604272.801815:0:23954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c07b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316618496:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787604272.801885:0:23954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604272.801931:0:23954:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08898b000 going to sleep for 11 seconds 00000100:00100000:2.0:1787604272.804623:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316618496 00000100:00100000:2.0:1787604272.804636:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316618496 00000100:00100000:2.0:1787604272.804718:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787604272.804735:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a04ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+22:23954:x1874438316618496:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787604272.804750:0:21914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604272.804767:0:21914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a0bc44fa00/0x6c241a9cc41dd4d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd4d2 expref: -99 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604272.804792:0:21914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a0bc44fa00/0x6c241a9cc41dd4d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd4d2 expref: 23 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604272.804803:0:21914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a0bc44fa00/0x6c241a9cc41dd4d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd4d2 expref: 23 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604272.804812:0:21914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a0bc44fa00, rc 0) 00000100:00100000:2.0:1787604272.804878:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a04ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+23:23954:x1874438316618496:12345-0@lo:101:mount.lustre.0 Request processed in 146us (2993us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604272.813308:0:23954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c07b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316618496:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787604272.813361:0:23954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e000/0x6c241a9cc41dd4d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd4d9 expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604272.813375:0:23954:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e000/0x6c241a9cc41dd4d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd4d9 expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787604272.813940:0:23954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1787604272.814234:0:23954:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787604272.814467:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1787604272.814509:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1787604272.814571:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1787604272.814609:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1787604272.814641:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1787604272.814707:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1787604272.814744:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1787604272.814777:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1787604272.814823:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1787604272.814856:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1787604272.814885:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1787604272.814952:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1787604272.814960:0:23954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1787604272.815028:0:23954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a090b79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316618624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787604272.815092:0:23954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604272.815131:0:23954:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0908f1300 going to sleep for 11 seconds 00000100:00100000:0.0:1787604272.815714:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316618624 00000100:00100000:0.0:1787604272.815723:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316618624 00000100:00100000:0.0:1787604272.815769:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787604272.815779:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a04cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:23954:x1874438316618624:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787604272.815997:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a04cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:23954:x1874438316618624:12345-0@lo:501:mount.lustre.0 Request processed in 218us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604272.816005:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787604272.817069:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787604272.818755:0:23954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a090b79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316618624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787604272.818817:0:23954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a090b79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316618752:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787604272.818894:0:23954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604272.818931:0:23954:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0908f1300 going to sleep for 11 seconds 00000100:00100000:0.0:1787604272.819315:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316618752 00000100:00100000:0.0:1787604272.819323:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316618752 00000100:00100000:0.0:1787604272.819371:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787604272.819380:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a08af2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+23:23954:x1874438316618752:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787604272.819591:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a08af2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+23:23954:x1874438316618752:12345-0@lo:503:mount.lustre.0 Request processed in 211us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604272.819599:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787604272.820875:0:23954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a090b79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316618752:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787604272.821793:0:23954:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787604272.821875:0:23954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a090b79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316618880:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787604272.821952:0:23954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604272.822003:0:23954:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0908f1300 going to sleep for 11 seconds 00000100:00100000:1.0:1787604272.822564:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316618880 00000100:00100000:1.0:1787604272.822588:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316618880 00000100:00100000:1.0:1787604272.822678:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787604272.822730:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a08af2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+23:23954:x1874438316618880:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787604272.822932:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a08af2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+23:23954:x1874438316618880:12345-0@lo:502:mount.lustre.0 Request processed in 244us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604272.822940:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787604272.823080:0:23954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a090b79180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316618880:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787604272.829745:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1787604272.829829:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1787604272.829869:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1787604272.829898:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1787604272.829923:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1787604272.829960:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1787604272.829988:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1787604272.830022:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1787604272.830071:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1787604272.830127:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1787604272.830158:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1787604272.830209:0:23954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316619008:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787604272.830287:0:23954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604272.830327:0:23954:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a085489180 going to sleep for 11 seconds 00000100:00100000:2.0:1787604272.830413:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316619008 00000100:00100000:2.0:1787604272.830422:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316619008 00000100:00100000:2.0:1787604272.830472:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787604272.830482:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a08af2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+23:23954:x1874438316619008:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787604272.830712:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a08af2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+23:23954:x1874438316619008:12345-0@lo:502:mount.lustre.0 Request processed in 206us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604272.830726:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787604272.835532:0:23954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316619008:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787604272.835755:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1787604272.835771:0:23954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787604272.842631:0:23959:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787604272.842646:0:23959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787604272.842649:0:23959:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787604272.842656:0:23959:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa09f82148800 00000020:00000080:3.0:1787604272.842658:0:23959:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787604272.842667:0:23959:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787604272.842670:0:23959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787604272.842671:0:23959:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787604272.842673:0:23959:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787604272.842675:0:23959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787604272.842677:0:23959:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787604272.842680:0:23959:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa09f82148800 00000020:00000080:3.0:1787604272.842682:0:23959:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787604272.842766:0:23959:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787604272.842770:0:23959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787604272.842772:0:23959:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787604272.842774:0:23959:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787604272.842777:0:23959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787604272.842778:0:23959:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787604272.842781:0:23959:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa09f82148800 00000020:00000080:3.0:1787604272.842783:0:23959:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787604272.842815:0:23959:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787604272.842817:0:23959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787604272.842818:0:23959:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787604272.842821:0:23959:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787604272.842823:0:23959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787604272.842824:0:23959:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787604272.842827:0:23959:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa09f82148800 00000020:00000080:3.0:1787604272.842829:0:23959:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787604272.842862:0:23959:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787604272.842865:0:23959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787604272.842866:0:23959:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787604272.842869:0:23959:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1787604272.849755:0:23954:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787604272.849798:0:23954:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787604272.849815:0:23954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e000/0x6c241a9cc41dd4d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd4d9 expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604272.849828:0:23954:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e000/0x6c241a9cc41dd4d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd4d9 expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787604272.849880:0:23954:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787604272.849890:0:23954:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa09f82148800 10000000:01000000:1.0:1787604272.849893:0:23954:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa09f82148800 10000000:01000000:1.0:1787604272.849897:0:23954:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787604272.849903:0:23954:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa09f82148800 from 1 10000000:01000000:1.0:1787604272.849918:0:23954:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787604272.849956:0:23954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0813d2200/0x6c241a9cc41dd4e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604272.849964:0:23954:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0a0813d2200/0x6c241a9cc41dd4e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604272.849976:0:23954:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0a0813d2200/0x6c241a9cc41dd4e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604272.850000:0:23954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7270000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316619136:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787604272.850068:0:23954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604272.850109:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316619136 00000100:00100000:1.0:1787604272.850117:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316619136 00000100:00100000:1.0:1787604272.850158:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787604272.850167:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a08af2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+23:23954:x1874438316619136:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787604272.850179:0:21915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604272.850191:0:21915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a0813d2600/0x6c241a9cc41dd4e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd4e0 expref: -99 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604272.850213:0:21915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a0813d2600/0x6c241a9cc41dd4e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd4e0 expref: 24 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604272.850223:0:21915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a0813d2600/0x6c241a9cc41dd4e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd4e0 expref: 24 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604272.850241:0:21915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a0813d2600, rc 0) 00000100:00100000:1.0:1787604272.850274:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a08af2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:23954:x1874438316619136:12345-0@lo:101:mount.lustre.0 Request processed in 108us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604272.850282:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787604272.850323:0:23954:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a085489a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787604272.850354:0:23954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7270000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316619136:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787604272.850368:0:23954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0a0813d2200/0x6c241a9cc41dd4e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd4e7 expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604272.850377:0:23954:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0a0813d2200/0x6c241a9cc41dd4e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd4e7 expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787604272.850991:0:23954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1787604272.851248:0:23954:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787604272.851473:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1787604272.851509:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1787604272.855456:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1787604272.855563:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1787604272.855617:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1787604272.855670:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1787604272.855729:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1787604272.855765:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1787604272.855814:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1787604272.855854:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1787604272.855887:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1787604272.855936:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1787604272.855974:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1787604272.856010:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1787604272.856074:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1787604272.856110:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1787604272.856143:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1787604272.856191:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1787604272.856226:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1787604272.856259:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1787604272.856307:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1787604272.856346:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1787604272.856377:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1787604272.856450:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1787604272.856486:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1787604272.868340:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1787604272.868487:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1787604272.868535:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1787604272.868564:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1787604272.868602:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1787604272.868633:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1787604272.868664:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1787604272.868754:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1787604272.868807:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1787604272.868844:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1787604272.868907:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1787604272.868947:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1787604272.868979:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1787604272.869024:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1787604272.869059:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1787604272.869090:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1787604272.869116:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1787604272.869159:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1787604272.869190:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1787604272.869219:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1787604272.869262:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1787604272.869294:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1787604272.869322:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1787604272.869410:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1787604272.869441:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1787604272.869493:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1787604272.869500:0:23954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1787604272.869621:0:23954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f13100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316619264:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787604272.869763:0:23954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604272.869852:0:23954:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a082e2dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787604272.869901:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316619264 00000100:00100000:1.0:1787604272.869920:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316619264 00000100:00100000:1.0:1787604272.870001:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787604272.870013:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a08af28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:23954:x1874438316619264:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787604272.870290:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a08af28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:23954:x1874438316619264:12345-0@lo:501:mount.lustre.0 Request processed in 277us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604272.870298:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787604272.870574:0:23954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f13100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316619264:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787604272.870610:0:23954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f13100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316619392:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787604272.870651:0:23954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604272.870668:0:23954:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a082e2dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787604272.870726:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316619392 00000100:00100000:0.0:1787604272.870732:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316619392 00000100:00100000:0.0:1787604272.870757:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787604272.870764:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a08af2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:23954:x1874438316619392:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787604272.870896:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a08af2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:23954:x1874438316619392:12345-0@lo:503:mount.lustre.0 Request processed in 132us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604272.870902:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787604272.870943:0:23954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f13100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316619392:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787604272.871920:0:23954:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787604272.872014:0:23954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f13100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316619520:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787604272.872061:0:23954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604272.872099:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316619520 00000100:00100000:0.0:1787604272.872104:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316619520 00000100:00100000:0.0:1787604272.872135:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787604272.872143:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:23954:x1874438316619520:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787604272.872334:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89735450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:23954:x1874438316619520:12345-0@lo:502:mount.lustre.0 Request processed in 191us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604272.872341:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787604272.872398:0:23954:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a082e2dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787604272.872415:0:23954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f13100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316619520:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787604272.873271:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1787604272.873332:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1787604272.873367:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1787604272.873417:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1787604272.873456:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1787604272.873505:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1787604272.873628:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1787604272.873664:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1787604272.873792:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1787604272.873835:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1787604272.873874:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1787604272.873931:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1787604272.873972:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1787604272.874025:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1787604272.874080:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1787604272.874117:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1787604272.874151:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1787604272.874204:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1787604272.874245:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1787604272.874279:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1787604272.874327:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1787604272.874362:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1787604272.874394:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1787604272.874443:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1787604272.874478:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1787604272.874510:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1787604272.877804:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1787604272.877864:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1787604272.877908:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1787604272.877983:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1787604272.878036:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1787604272.878077:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1787604272.878117:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1787604272.878506:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1787604272.878583:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1787604272.878630:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1787604272.878665:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1787604272.879409:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1787604272.879467:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1787604272.879487:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1787604272.879503:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1787604272.879550:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1787604272.879601:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1787604272.879636:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1787604272.879667:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1787604272.879811:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1787604272.879847:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1787604272.879879:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1787604272.879953:0:23954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f13100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316619648:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787604272.880030:0:23954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604272.880104:0:23954:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a082e2dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787604272.880155:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316619648 00000100:00100000:1.0:1787604272.880164:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316619648 00000100:00100000:1.0:1787604272.880243:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787604272.880253:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:23954:x1874438316619648:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787604272.880437:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:23954:x1874438316619648:12345-0@lo:502:mount.lustre.0 Request processed in 185us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604272.880445:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787604272.880565:0:23954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f13100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316619648:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787604272.880650:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1787604272.880715:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1787604272.880738:0:23954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f13100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316619776:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787604272.880773:0:23954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604272.880793:0:23954:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a082e2dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787604272.883448:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316619776 00000100:00100000:1.0:1787604272.883463:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316619776 00000100:00100000:1.0:1787604272.883543:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787604272.883555:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:23954:x1874438316619776:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787604272.883852:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:23954:x1874438316619776:12345-0@lo:502:mount.lustre.0 Request processed in 298us (3077us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604272.883860:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787604272.883945:0:23954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f13100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316619776:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787604272.884099:0:23954:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1787604272.884119:0:23954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787604272.886455:0:23965:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787604272.886473:0:23965:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffffa0a08328cd28) 00000020:00000080:2.0:1787604272.886503:0:23965:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1787604272.886619:0:23965:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa09f82148800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787604272.886624:0:23965:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa09f82148800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787604272.886627:0:23965:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa09f82148800 3 00010000:00080000:2.0:1787604272.886663:0:23965:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa09f84047800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.116@tcp at head 00000040:00080000:0.0:1787604272.889411:0:21956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787604272.889608:0:23965:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1787604272.889898:0:23965:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787604272.889936:0:23965:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787604272.889948:0:23965:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x6c241a9cc41dd4f5 00000100:00080000:2.0:1787604272.889958:0:23965:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787604272.889963:0:23965:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa09f84047800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1787604272.890000:0:23965:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a0c0c07800 x1874438316619904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787604272.890033:0:23965:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787604272.890624:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3449:1874438316619904:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787604272.890716:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604272.890957:0:21921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316619904 00000100:00100000:2.0:1787604272.890965:0:21921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316619904 00000100:00100000:2.0:1787604272.891007:0:21921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787604272.891015:0:21921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3449:x1874438316619904:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787604272.891040:0:21921:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 653 last 0 00000020:00000080:2.0:1787604272.891093:0:21921:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x6c241a9cc41dd4fc 00000004:00100000:2.0:1787604272.891110:0:21921:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787604272.891144:0:21921:0:(import.c:65:import_set_state_nolock()) ffffa09f8214f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787604272.891201:0:21921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3449:x1874438316619904:12345-0@lo:38:llog_process_th.0 Request processed in 184us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604272.891217:0:21921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787604272.891295:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0a0c0c07800 x1874438316619904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787604282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604272.891305:0:3449:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787604272.891313:0:3449:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1787604272.891319:0:3449:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787604272.891323:0:3449:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787604272.891326:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f84047800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787604272.891331:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3449:1874438316619904:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787604272.892436:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787604272.892442:0:492:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787604272.892445:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787604272.892448:0:492:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787604272.892477:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787604272.892480:0:492:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787604272.892483:0:492:0:(import.c:65:import_set_state_nolock()) ffffa09f889a1000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787604272.892489:0:492:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 647 00000100:00080000:0.0:1787604272.892494:0:492:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787604272.892500:0:492:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffffa09f889a1000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1787604272.892530:0:492:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a084f13800 x1874438316620544/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787604272.892583:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3452:1874438316620032:0@lo:400:kworker.0 00000100:00100000:0.0:1787604272.892637:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604272.892664:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bc758380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3452:1874438316620672:0@lo:400:kworker.0 00000100:00100000:0.0:1787604272.892707:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604272.892728:0:3452:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787604272.892733:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3452:1874438316620160:0@lo:400:kworker.0 00000100:00100000:0.0:1787604272.892754:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604272.892770:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bc759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3452:1874438316620800:0@lo:400:kworker.0 00000100:00100000:0.0:1787604272.892789:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604272.892816:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316620288:0@lo:400:kworker.0 00000100:00100000:0.0:1787604272.892852:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604272.892867:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bc75bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3450:1874438316620928:0@lo:400:kworker.0 00000100:00100000:0.0:1787604272.892883:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604272.892894:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787604272.892898:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316620416:0@lo:400:kworker.0 00000100:00100000:0.0:1787604272.892934:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604272.892964:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316620032 00000100:00100000:0.0:1787604272.892970:0:21925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316620032 00000100:00100000:0.0:1787604272.893010:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316620288 00000100:00100000:0.0:1787604272.893013:0:21925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316620288 00000100:00100000:0.0:1787604272.893028:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787604272.893036:0:21925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3452:x1874438316620032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604272.893084:0:21925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3452:x1874438316620032:12345-0@lo:400:kworker.0 Request processed in 49us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604272.893091:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787604272.893107:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787604272.893114:0:21925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc75b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316620288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604272.893146:0:21925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc75b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316620288:12345-0@lo:400:kworker.0 Request processed in 33us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604272.893152:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787604272.893169:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316620672 00000100:00100000:0.0:1787604272.893172:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316620672 00000100:00100000:0.0:1787604272.893186:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316620160 00000100:00100000:0.0:1787604272.893189:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316620160 00000100:00100000:0.0:1787604272.893197:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316620800 00000100:00100000:0.0:1787604272.893199:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316620800 00000100:00100000:0.0:1787604272.893228:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316620928 00000100:00100000:0.0:1787604272.893231:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316620928 00000100:00080000:1.0:1787604272.893244:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787604272.893250:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787604272.893270:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787604272.893277:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3452:x1874438316620672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604272.893305:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3452:x1874438316620672:12345-0@lo:400:kworker.0 Request processed in 28us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604272.893310:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787604272.893321:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787604272.893326:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc75b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3452:x1874438316620160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604272.893349:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc75b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3452:x1874438316620160:12345-0@lo:400:kworker.0 Request processed in 22us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604272.893354:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787604272.893365:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787604272.893370:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3452:x1874438316620800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604272.893391:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3452:x1874438316620800:12345-0@lo:400:kworker.0 Request processed in 22us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604272.893397:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787604272.893408:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787604272.893414:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc75a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3450:x1874438316620928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604272.893437:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc75a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3450:x1874438316620928:12345-0@lo:400:kworker.0 Request processed in 23us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604272.893443:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787604272.893468:0:23235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316620416 00000100:00100000:0.0:1787604272.893471:0:23235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316620416 00000100:00080000:1.0:1787604272.893507:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787604272.893522:0:23235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787604272.893531:0:23235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc758a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316620416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604272.893562:0:23235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc758a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316620416:12345-0@lo:400:kworker.0 Request processed in 33us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604272.893578:0:23235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787604272.893614:0:3452:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0a084f12d80 x1874438316620160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604272.893628:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3452:1874438316620160:0@lo:400:kworker.0 00010000:00080000:0.0:1787604272.893639:0:3452:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0a0bc759500 x1874438316620800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604272.893647:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bc759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3452:1874438316620800:0@lo:400:kworker.0 00000100:00100000:0.0:1787604272.893657:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3452:1874438316620032:0@lo:400:kworker.0 00010000:00080000:0.0:1787604272.893665:0:3452:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0a0bc758380 x1874438316620672/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604272.893673:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bc758380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3452:1874438316620672:0@lo:400:kworker.0 00010000:00080000:0.0:1787604272.893723:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0a084f11c00 x1874438316620416/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787604288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604272.893730:0:3450:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1787604272.893740:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316620416:0@lo:400:kworker.0 00000100:00100000:0.0:1787604272.893749:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316620288:0@lo:400:kworker.0 00010000:00080000:0.0:1787604272.893757:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0a0bc75bb80 x1874438316620928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604272.893763:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bc75bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3450:1874438316620928:0@lo:400:kworker.0 00000100:00100000:2.0:1787604272.897905:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3449:1874438316620544:0@lo:8:kworker.0 00000100:00100000:2.0:1787604272.897979:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1787604272.898260:0:23965:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787604272.898287:0:23965:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffffa09f81394d28) 00000020:00000080:2.0:1787604272.898313:0:23965:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000100:00100000:3.0:1787604272.898407:0:23233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316620544 00000100:00100000:3.0:1787604272.898417:0:23233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316620544 00000100:00100000:3.0:1787604272.898459:0:23233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787604272.898468:0:23233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0c06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3449:x1874438316620544:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787604272.898552:0:23233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0c06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3449:x1874438316620544:12345-0@lo:8:kworker.0 Request processed in 83us (572us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787604272.898560:0:23233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787604272.898597:0:3449:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787604272.898604:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f889a1000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787604272.898609:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787604272.898613:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3449:1874438316620544:0@lo:8:kworker.0 00000020:01000004:2.0:1787604272.898633:0:23965:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa09f82148800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787604272.898638:0:23965:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa09f82148800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787604272.898641:0:23965:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa09f82148800 3 00010000:00080000:2.0:1787604272.898673:0:23965:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa09f84040000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.116@tcp at head 00010000:00010000:0.0:1787604272.908825:0:23965:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1787604272.909040:0:23965:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1787604272.909092:0:23965:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787604272.909106:0:23965:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x6c241a9cc41dd50a 00000100:00080000:0.0:1787604272.909117:0:23965:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787604272.909123:0:23965:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffffa09f84040000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1787604272.909155:0:23965:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a0bc75bb80 x1874438316621056/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787604272.909188:0:23965:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1787604272.909220:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bc75bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3449:1874438316621056:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787604272.909284:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604272.909914:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316621056 00000100:00100000:0.0:1787604272.909922:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316621056 00000100:00100000:0.0:1787604272.909966:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787604272.909974:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3449:x1874438316621056:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787604272.909999:0:21920:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 653 last 0 00000020:00000080:0.0:1787604272.910032:0:21920:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x6c241a9cc41dd511 00000004:00100000:0.0:1787604272.910048:0:21920:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787604272.910079:0:21920:0:(import.c:65:import_set_state_nolock()) ffffa09f8a819800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787604272.910141:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3449:x1874438316621056:12345-0@lo:38:llog_process_th.0 Request processed in 166us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604272.910149:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787604272.910191:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0a0bc75bb80 x1874438316621056/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787604282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604272.910202:0:3449:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787604272.910209:0:3449:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1787604272.910216:0:3449:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787604272.910220:0:3449:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787604272.910222:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f84040000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787604272.910228:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bc75bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3449:1874438316621056:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787604272.910419:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787604272.910425:0:492:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787604272.910428:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787604272.910431:0:492:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1787604272.911232:0:23965:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1787604272.912135:0:23954:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787604272.912171:0:23954:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787604272.912190:0:23954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a0813d2200/0x6c241a9cc41dd4e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd4e7 expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604272.912202:0:23954:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0a0813d2200/0x6c241a9cc41dd4e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd4e7 expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787604272.912264:0:23954:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787604272.912266:0:23954:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787604272.912267:0:23954:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787604272.912269:0:23954:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787604272.912270:0:23954:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787604272.912272:0:23954:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787604272.912273:0:23954:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787604272.912276:0:23954:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787604272.912277:0:23954:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787604272.912281:0:23954:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1787604272.912283:0:23954:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787604272.912285:0:23954:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787604272.912286:0:23954:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787604272.912287:0:23954:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787604272.912288:0:23954:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787604272.912289:0:23954:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787604272.912290:0:23954:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787604272.912291:0:23954:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787604272.912292:0:23954:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787604272.913360:0:23954:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787604272.913383:0:23954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7792300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316621184:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787604272.913467:0:23954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604272.913534:0:23954:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a092182480 going to sleep for 11 seconds 00000100:00100000:0.0:1787604272.915041:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316621184 00000100:00100000:0.0:1787604272.915051:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316621184 00000100:00100000:0.0:1787604272.915448:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787604272.915460:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:23954:x1874438316621184:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787604272.915503:0:21914:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787604272.915530:0:21914:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787604273.002826:0:21914:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787604273.002847:0:21914:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787604273.002925:0:21936:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787604273.002932:0:21936:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787604273.002954:0:21936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0a0bc44ee00/0x6c241a9cc41dd518 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604273.002973:0:21936:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa09f89d23c00/0x6c241a9cc41dd48c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd485 expref: 24 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604273.002983:0:21936:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0a080030a00/0x6c241a9cc41dd49a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd493 expref: 24 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604273.002991:0:21936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0a0bc44ee00/0x6c241a9cc41dd518 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604273.003048:0:21936:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0a080030a00/0x6c241a9cc41dd49a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c241a9cc41dd493 expref: 24 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604273.003067:0:21936:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0a080030a00/0x6c241a9cc41dd49a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c241a9cc41dd493 expref: 24 pid: 21913 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604273.003081:0:21936:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c06680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21936:1874438316621312:0@lo:104: 00000100:00100000:2.0:1787604273.003247:0:21936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604273.003300:0:21903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316621312 00000100:00100000:3.0:1787604273.003307:0:21903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316621312 00010000:00010000:2.0:1787604273.003356:0:21936:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa09f89d23c00/0x6c241a9cc41dd48c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c241a9cc41dd485 expref: 24 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604273.003365:0:21936:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa09f89d23c00/0x6c241a9cc41dd48c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c241a9cc41dd485 expref: 24 pid: 21914 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604273.003374:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787604273.003377:0:21936:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c04000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21936:1874438316621440:0@lo:104: 00000100:00100000:3.0:1787604273.003388:0:21903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0c05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+3:21936:x1874438316621312:12345-0@lo:104: 00010000:00010000:3.0:1787604273.003402:0:21903:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0a080030000/0x6c241a9cc41dd493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c241a9cc41dd49a expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604273.003404:0:21936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604273.003416:0:21936:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09f81b41240 going to sleep for 11 seconds 00000100:00100000:1.0:1787604273.003576:0:21904:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1787604273.003588:0:21904:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1787604273.003715:0:21903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787604273.003723:0:21903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0c05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+3:21936:x1874438316621312:12345-0@lo:104: Request processed in 339us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604273.003737:0:21936:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c06680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21936:1874438316621312:0@lo:104: 00010000:00010000:1.0:1787604273.003809:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787604273.003821:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0a080030000/0x6c241a9cc41dd493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c241a9cc41dd49a expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604273.003832:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a080030000 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:1.0:1787604273.003836:0:21909:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0a080030000/0x6c241a9cc41dd493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c241a9cc41dd49a expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604273.003846:0:21909:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0a080030000/0x6c241a9cc41dd493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c241a9cc41dd49a expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787604273.003863:0:21909:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0a080030000/0x6c241a9cc41dd493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c241a9cc41dd49a expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787604273.003868:0:21909:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787604273.003900:0:21909:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0a080030000/0x6c241a9cc41dd493 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd49a expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604273.003907:0:21909:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787604273.003927:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0a080030000/0x6c241a9cc41dd493 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd49a expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604273.003934:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0a080030000/0x6c241a9cc41dd493 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd49a expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604273.003948:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604273.003950:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604273.003953:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604273.003965:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3451:1874438316621568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787604273.003996:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604273.004000:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787604273.004030:0:21903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316621440 00000100:00100000:3.0:1787604273.004035:0:21903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316621440 00000100:00100000:3.0:1787604273.004057:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787604273.004066:0:21903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0c04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+3:21936:x1874438316621440:12345-0@lo:104: 00010000:00010000:3.0:1787604273.004074:0:21903:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3c00/0x6c241a9cc41dd485 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c241a9cc41dd48c expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604273.004140:0:21903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787604273.004145:0:21903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0c04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+3:21936:x1874438316621440:12345-0@lo:104: Request processed in 82us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604273.004151:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1787604273.004169:0:22982:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787604273.004174:0:22982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3c00/0x6c241a9cc41dd485 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c241a9cc41dd48c expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604273.004181:0:22982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0813d3c00 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:3.0:1787604273.004184:0:22982:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3c00/0x6c241a9cc41dd485 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c241a9cc41dd48c expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604273.004191:0:22982:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3c00/0x6c241a9cc41dd485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c241a9cc41dd48c expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787604273.004197:0:22982:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3c00/0x6c241a9cc41dd485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c241a9cc41dd48c expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787604273.004215:0:22982:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1787604273.004224:0:21936:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c04000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21936:1874438316621440:0@lo:104: 00010000:00010000:2.0:1787604273.004244:0:21936:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0a0bc44ee00/0x6c241a9cc41dd518 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604273.004443:0:21905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316621568 00000100:00100000:1.0:1787604273.004448:0:21905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316621568 00010000:00010000:3.0:1787604273.004896:0:22982:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3c00/0x6c241a9cc41dd485 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd48c expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604273.004905:0:22982:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787604273.004924:0:22982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3c00/0x6c241a9cc41dd485 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd48c expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604273.004932:0:22982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3c00/0x6c241a9cc41dd485 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd48c expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604273.004949:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604273.004951:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604273.004953:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604273.004974:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a090b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3452:1874438316621696:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787604273.004981:0:21905:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0a080030a00/0x6c241a9cc41dd49a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c241a9cc41dd493 expref: 25 pid: 21913 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604273.005013:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604273.005017:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787604273.005028:0:21905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc75bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+25:3451:x1874438316621568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787604273.005040:0:21905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604273.005047:0:21905:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0a080030a00/0x6c241a9cc41dd49a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c241a9cc41dd493 expref: 25 pid: 21913 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604273.005060:0:21905:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0a080030a00/0x6c241a9cc41dd49a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c241a9cc41dd493 expref: 25 pid: 21913 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604273.005082:0:21905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a080030a00/0x6c241a9cc41dd49a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c241a9cc41dd493 expref: 25 pid: 21913 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604273.005109:0:21905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787604273.005235:0:21905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc75bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:3451:x1874438316621568:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604273.005244:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787604273.005263:0:21905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316621696 00000100:00100000:1.0:1787604273.005268:0:21905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316621696 00010000:00010000:1.0:1787604273.005282:0:21905:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa09f89d23c00/0x6c241a9cc41dd48c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c241a9cc41dd485 expref: 24 pid: 21914 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604273.005309:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787604273.005318:0:21905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc758380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:3452:x1874438316621696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787604273.005327:0:21905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604273.005332:0:21905:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa09f89d23c00/0x6c241a9cc41dd48c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c241a9cc41dd485 expref: 24 pid: 21914 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604273.005342:0:21905:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa09f89d23c00/0x6c241a9cc41dd48c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c241a9cc41dd485 expref: 24 pid: 21914 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604273.005353:0:21905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09f89d23c00/0x6c241a9cc41dd48c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c241a9cc41dd485 expref: 24 pid: 21914 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604273.005376:0:21905:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0a0bc44ee00/0x6c241a9cc41dd518 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604273.005385:0:21905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a0bc44ee00/0x6c241a9cc41dd518 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787604273.005409:0:21905:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.018282278s 00010000:00010000:1.0:1787604273.005413:0:21905:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0a0bc44ee00/0x6c241a9cc41dd518 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604273.005420:0:21905:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0a0bc44ee00/0x6c241a9cc41dd518 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604273.005427:0:21905:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0a0bc44ee00/0x6c241a9cc41dd518 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604273.005433:0:21905:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0a0bc44ee00/0x6c241a9cc41dd518 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604273.005439:0:21905:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc44ee00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:1.0:1787604273.005442:0:21905:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0a0bc44ee00/0x6c241a9cc41dd518 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604273.005449:0:21905:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0a0bc44ee00/0x6c241a9cc41dd518 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604273.005474:0:21905:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0a0bc44ee00/0x6c241a9cc41dd518 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604273.005483:0:21905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787604273.005522:0:21905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc758380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+23:3452:x1874438316621696:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604273.005530:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1787604273.005552:0:21936:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0a0bc44ee00/0x6c241a9cc41dd518 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604273.005574:0:21936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0a0bc44ee00/0x6c241a9cc41dd518 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604273.005580:0:21936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0bc44ee00/0x6c241a9cc41dd518 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604273.006090:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a090b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3452:1874438316621696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787604273.007048:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3451:1874438316621568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787604273.011375:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89737450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+22:23954:x1874438316621184:12345-0@lo:253:mount.lustre.0 Request processed in 95908us (97899us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604273.011389:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787604273.011596:0:23954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7792300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57b6d7db-5b8e-4468-b46a-6c89167d0f60:23954:1874438316621184:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787604273.011611:0:23954:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787604273.011615:0:23954:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787604273.011616:0:23954:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787604273.011618:0:23954:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787604273.011632:0:23954:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787604273.011633:0:23954:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787604273.011634:0:23954:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787604273.011635:0:23954:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787604273.011637:0:23954:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787604273.011638:0:23954:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787604273.011652:0:23954:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787604273.012065:0:23954:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787604273.012920:0:23954:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787604273.013172:0:23954:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787604273.013325:0:23954:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787604273.013633:0:23954:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787604273.014023:0:23954:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787604273.015159:0:23954:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1787604273.092643:0:23954:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787604273.092651:0:23954:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787604273.092714:0:23954:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787604273.092795:0:23954:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.116@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787604273.092815:0:23954:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1787604273.092850:0:23954:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:2.0:1787604273.143234:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7793b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316621824:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787604273.143308:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604273.147804:0:23236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316621824 00000100:00100000:3.0:1787604273.147817:0:23236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316621824 00000100:00100000:3.0:1787604273.148009:0:23236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787604273.148019:0:23236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0c04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316621824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787604273.148054:0:23236:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787604273.148134:0:23236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0c04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316621824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (4826us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604273.148204:0:23236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787604273.151876:0:3453:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0a0b7793b80 x1874438316621824/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787604289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604273.151902:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7793b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316621824:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787604273.590977:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604273.653953:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316621952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787604273.654054:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604273.654135:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316621952 00000100:00100000:1.0:1787604273.654145:0:21925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316621952 00000100:00100000:1.0:1787604273.654204:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787604273.654215:0:21925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316621952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787604273.654270:0:21925:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787604273.654322:0:21925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316621952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604273.654330:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787604273.654394:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316621952:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787604273.654807:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787604273.654818:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bc759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3450:1874438316622080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787604273.654855:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604273.654922:0:21926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316622080 00000100:00100000:0.0:1787604273.654928:0:21926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316622080 00000100:00100000:0.0:1787604273.654969:0:21926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787604273.654977:0:21926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0c06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3450:x1874438316622080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787604273.655005:0:21926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787604273.655050:0:21926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0c06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3450:x1874438316622080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604273.655057:0:21926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787604273.655092:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bc759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3450:1874438316622080:0@lo:41:osp-pre-1-0.0 10000000:01000000:0.0:1787604274.101780:0:21917:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787604274.101789:0:21917:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa09f891cd000 from 14 10000000:01000000:0.0:1787604274.101796:0:21917:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787604274.101843:0:21917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa09f89d23400/0x6c241a9cc41dd51f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604274.101855:0:21917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa09f89d23400/0x6c241a9cc41dd51f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604274.101867:0:21917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa09f89d23400/0x6c241a9cc41dd51f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604274.101895:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bc759500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316622208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787604274.101962:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604274.102015:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a085463d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787604274.102722:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316622208 00000100:00100000:2.0:1787604274.102732:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316622208 00000100:00100000:2.0:1787604274.102785:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787604274.102797:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+22:21917:x1874438316622208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787604274.102812:0:21915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604274.102832:0:21915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a0bc44e200/0x6c241a9cc41dd526 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd51f expref: -99 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604274.102858:0:21915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a0bc44e200/0x6c241a9cc41dd526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd51f expref: 23 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604274.102869:0:21915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a0bc44e200/0x6c241a9cc41dd526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd51f expref: 23 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604274.102878:0:21915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a0bc44e200, rc 0) 00000100:00100000:2.0:1787604274.102945:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+23:21917:x1874438316622208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604274.102951:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787604274.103342:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bc759500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316622208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787604274.103365:0:21917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa09f89d23400/0x6c241a9cc41dd51f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd526 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604274.103378:0:21917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa09f89d23400/0x6c241a9cc41dd51f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd526 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604274.103449:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7792a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316622336:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787604274.103492:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604274.103534:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0832a7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787604274.103678:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316622336 00000100:00100000:0.0:1787604274.103731:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316622336 00000100:00100000:0.0:1787604274.103767:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787604274.103776:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+23:21917:x1874438316622336:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787604274.103792:0:21913:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787604274.103810:0:21913:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787604274.103814:0:21913:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1787604274.103888:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+23:21917:x1874438316622336:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604274.103894:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787604274.103930:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7792a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316622336:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787604274.103989:0:21917:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787604274.103996:0:21917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa09f89d23400/0x6c241a9cc41dd51f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd526 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604274.104005:0:21917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa09f89d23400/0x6c241a9cc41dd51f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd526 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787604274.104014:0:21917:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787604274.104018:0:21917:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0a0bc52f000 from 14 10000000:01000000:0.0:1787604274.104021:0:21917:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787604274.104045:0:21917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa09f89d23200/0x6c241a9cc41dd52d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604274.104054:0:21917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa09f89d23200/0x6c241a9cc41dd52d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604274.104062:0:21917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa09f89d23200/0x6c241a9cc41dd52d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604274.104076:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bc759f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316622464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787604274.104109:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604274.104130:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a086d470c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787604274.104142:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316622464 00000100:00100000:0.0:1787604274.104145:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316622464 00000100:00100000:0.0:1787604274.104167:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787604274.104173:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+23:21917:x1874438316622464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787604274.104181:0:21913:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604274.104192:0:21913:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa09f89d22600/0x6c241a9cc41dd534 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd52d expref: -99 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604274.104209:0:21913:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa09f89d22600/0x6c241a9cc41dd534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd52d expref: 24 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604274.104219:0:21913:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa09f89d22600/0x6c241a9cc41dd534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd52d expref: 24 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604274.104226:0:21913:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa09f89d22600, rc 0) 00000100:00100000:0.0:1787604274.104255:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:21917:x1874438316622464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604274.104261:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787604274.104294:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bc759f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316622464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787604274.104306:0:21917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa09f89d23200/0x6c241a9cc41dd52d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd534 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604274.104314:0:21917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa09f89d23200/0x6c241a9cc41dd52d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd534 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604274.104358:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bc759f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316622592:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787604274.104396:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604274.104409:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0bf0c9000 going to sleep for 11 seconds 00000100:00100000:0.0:1787604274.104422:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316622592 00000100:00100000:0.0:1787604274.104426:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316622592 00000100:00100000:0.0:1787604274.104452:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787604274.104459:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:21917:x1874438316622592:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787604274.104469:0:21915:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787604274.104482:0:21915:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787604274.104486:0:21915:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1787604274.104573:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:21917:x1874438316622592:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604274.104580:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787604274.104610:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bc759f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316622592:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787604274.104650:0:21917:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787604274.104656:0:21917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa09f89d23200/0x6c241a9cc41dd52d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd534 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604274.104664:0:21917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa09f89d23200/0x6c241a9cc41dd52d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd534 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604274.616581:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787604274.688061:0:22580:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787604275.644606:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604275.962098:0:3449:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787604255/real 1787604255] req@ffffa09f89d90380 x1874438316609280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787604275 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787604275.962134:0:3449:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa09f89d90380 x1874438316609280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787604275 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787604275.962157:0:3449:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787604255/real 1787604255] req@ffffa09f89d91880 x1874438316609408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787604275 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787604275.962171:0:3449:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa09f89d91880 x1874438316609408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787604275 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787604275.962190:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f884b0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787604275.962212:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787604275.962216:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316609280:0@lo:8:kworker.0 00000100:00080000:2.0:1787604275.962221:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa0a0bca77000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787604275.962226:0:3449:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787604275.962229:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316609408:0@lo:8:kworker.0 00000100:00080000:2.0:1787604275.962321:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787604275.962325:0:492:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787604275.962328:0:492:0:(import.c:65:import_set_state_nolock()) ffffa09f884b0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787604275.962332:0:492:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 635 00000100:00080000:2.0:1787604275.962337:0:492:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787604275.962344:0:492:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa09f884b0000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1787604275.962375:0:492:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a0c0c04e00 x1874438316622976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787604275.962388:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787604275.962406:0:492:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787604275.962408:0:492:0:(import.c:65:import_set_state_nolock()) ffffa0a0bca77000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787604275.962412:0:492:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 635 00000100:00080000:2.0:1787604275.962415:0:492:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787604275.962419:0:492:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0a0bca77000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1787604275.962432:0:492:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0a0c0c07800 x1874438316623104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787604275.962477:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787604275.962480:0:492:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787604275.962482:0:492:0:(import.c:65:import_set_state_nolock()) ffffa09f889a1000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787604275.962486:0:492:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffffa09f889a1000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1787604275.962508:0:492:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa09f89d93100 x1874438316623616/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787604275.962574:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3453:1874438316622848:0@lo:400:kworker.0 00000100:00100000:2.0:1787604275.962640:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604275.962981:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316623360:0@lo:400:kworker.0 00000100:00100000:1.0:1787604275.963017:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604275.963038:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3451:1874438316624000:0@lo:400:kworker.0 00000100:00100000:1.0:1787604275.963065:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604275.963085:0:3451:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787604275.963090:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3451:1874438316623232:0@lo:400:kworker.0 00000100:00100000:1.0:1787604275.963112:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604275.963126:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3451:1874438316623872:0@lo:400:kworker.0 00000100:00100000:1.0:1787604275.963149:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604275.963180:0:22565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316622848 00000100:00100000:1.0:1787604275.963188:0:22565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316622848 00000100:00100000:1.0:1787604275.963224:0:22565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316623360 00000100:00100000:1.0:1787604275.963227:0:22565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316623360 00000100:00100000:1.0:1787604275.963241:0:22565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787604275.963249:0:22565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1874438316622848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604275.963294:0:22565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1874438316622848:12345-0@lo:400:kworker.0 Request processed in 46us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604275.963302:0:22565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787604275.963317:0:22565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787604275.963323:0:22565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316623360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604275.963364:0:22565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316623360:12345-0@lo:400:kworker.0 Request processed in 41us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604275.963371:0:22565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787604275.963392:0:21921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316624000 00000100:00100000:1.0:1787604275.963396:0:21921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316624000 00000100:00100000:1.0:1787604275.963424:0:21921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316623232 00000100:00100000:1.0:1787604275.963427:0:21921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316623232 00000100:00100000:1.0:1787604275.963436:0:21921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316623872 00000100:00100000:1.0:1787604275.963438:0:21921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316623872 00000100:00100000:1.0:1787604275.963452:0:21921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787604275.963458:0:21921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3451:x1874438316624000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604275.963486:0:21921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3451:x1874438316624000:12345-0@lo:400:kworker.0 Request processed in 28us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604275.963505:0:21921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787604275.963516:0:21921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787604275.963522:0:21921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3451:x1874438316623232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604275.963548:0:21921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3451:x1874438316623232:12345-0@lo:400:kworker.0 Request processed in 27us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604275.963553:0:21921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787604275.963564:0:21921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787604275.963570:0:21921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3451:x1874438316623872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604275.963594:0:21921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3451:x1874438316623872:12345-0@lo:400:kworker.0 Request processed in 24us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604275.963599:0:21921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1787604275.963620:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787604275.963624:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787604275.963644:0:3451:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0a0c0c07b80 x1874438316623232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604275.963662:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3451:1874438316623232:0@lo:400:kworker.0 00010000:00080000:1.0:1787604275.963717:0:3451:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa09f89d91500 x1874438316623872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604275.963727:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3451:1874438316623872:0@lo:400:kworker.0 00000100:00100000:1.0:1787604275.963737:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316623360:0@lo:400:kworker.0 00010000:00080000:1.0:1787604275.963744:0:3451:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa09f89d92a00 x1874438316624000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604275.963751:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3451:1874438316624000:0@lo:400:kworker.0 00000100:00100000:3.0:1787604275.965641:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3452:1874438316622720:0@lo:400:kworker.0 00000100:00100000:3.0:1787604275.965941:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604275.966012:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316623488:0@lo:400:kworker.0 00000100:00100000:3.0:1787604275.966043:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604275.966081:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3452:1874438316624128:0@lo:400:kworker.0 00000100:00100000:3.0:1787604275.966113:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604275.966154:0:23235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316623488 00000100:00100000:3.0:1787604275.966160:0:23235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316623488 00000100:00100000:3.0:1787604275.966211:0:23235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787604275.966221:0:23235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090b78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3452:x1874438316623488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604275.966270:0:23235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090b78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3452:x1874438316623488:12345-0@lo:400:kworker.0 Request processed in 50us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604275.966278:0:23235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787604275.966324:0:3452:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa09f89d90380 x1874438316623488/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787604291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604275.966337:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316623488:0@lo:400:kworker.0 00000100:00100000:2.0:1787604275.967234:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3453:1874438316623744:0@lo:400:kworker.0 00000100:00100000:2.0:1787604275.967285:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604275.967322:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3453:1874438316624256:0@lo:400:kworker.0 00000100:00100000:3.0:1787604275.967342:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316624128 00000100:00100000:3.0:1787604275.967348:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316624128 00000100:00100000:2.0:1787604275.967363:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604275.967387:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316623744 00000100:00100000:3.0:1787604275.967391:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316623744 00000100:00100000:2.0:1787604275.967403:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3453:1874438316622848:0@lo:400:kworker.0 00000100:00100000:3.0:1787604275.967405:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316624256 00000100:00100000:3.0:1787604275.967409:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316624256 00000100:00100000:2.0:1787604275.967440:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316622976:0@lo:8:kworker.0 00000100:00100000:2.0:1787604275.967468:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604275.967486:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316623104:0@lo:8:kworker.0 00000100:00100000:3.0:1787604275.967514:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787604275.967525:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3452:x1874438316624128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604275.967550:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604275.967573:0:3449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3449:1874438316623616:0@lo:8:kworker.0 00000100:00100000:1.0:1787604275.968101:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316622720 00000100:00100000:1.0:1787604275.968108:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316622720 00000100:00100000:1.0:1787604275.968156:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787604275.968164:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:3452:x1874438316622720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604275.968638:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3452:x1874438316624128:12345-0@lo:400:kworker.0 Request processed in 1113us (2522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604275.968647:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787604275.968670:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787604275.968678:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3453:x1874438316623744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604275.968752:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3453:x1874438316623744:12345-0@lo:400:kworker.0 Request processed in 76us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604275.968772:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787604275.968806:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787604275.968814:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3453:x1874438316624256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604275.968845:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3453:x1874438316624256:12345-0@lo:400:kworker.0 Request processed in 33us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604275.968851:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787604275.968872:0:23233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316622976 00000100:00100000:3.0:1787604275.968877:0:23233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316622976 00000100:00100000:3.0:1787604275.968894:0:23233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316623104 00000100:00100000:3.0:1787604275.968897:0:23233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316623104 00000100:00100000:3.0:1787604275.968924:0:23233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787604275.968930:0:23233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3449:x1874438316622976:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787604275.968955:0:23233:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 656 last 0 00000020:00000080:3.0:1787604275.968983:0:23233:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6c241a9cc41dd53b 00002000:00100000:3.0:1787604275.968997:0:23233:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffffa09f8834f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787604275.969001:0:23233:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787604275.969003:0:23233:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787604275.969247:0:23233:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787604275.969272:0:23233:0:(import.c:65:import_set_state_nolock()) ffffa09f8834b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787604275.969371:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:3452:x1874438316622720:12345-0@lo:400:kworker.0 Request processed in 1207us (3597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604275.969380:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1787604275.969611:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787604275.969616:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787604275.969619:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787604275.970899:0:23233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3449:x1874438316622976:12345-0@lo:8:kworker.0 Request processed in 1962us (3424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604275.972044:0:23233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787604275.972082:0:23233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787604275.972090:0:23233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89351f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3449:x1874438316623104:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787604275.972126:0:23233:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 656 last 0 00000020:00000080:3.0:1787604275.972165:0:23233:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6c241a9cc41dd542 00002000:00100000:3.0:1787604275.972191:0:23233:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffffa09f8834b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787604275.972195:0:23233:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787604275.972198:0:23233:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787604275.972560:0:23233:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787604275.972589:0:23233:0:(import.c:65:import_set_state_nolock()) ffffa09f88348800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787604275.972673:0:23233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89351f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3449:x1874438316623104:12345-0@lo:8:kworker.0 Request processed in 581us (5123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604275.972680:0:23233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787604275.972759:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3452:1874438316622720:0@lo:400:kworker.0 00010000:00080000:3.0:1787604275.972788:0:3452:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa09f89d93800 x1874438316624128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604275.972801:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3452:1874438316624128:0@lo:400:kworker.0 00010000:00080000:3.0:1787604275.972852:0:3453:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa09f89d90000 x1874438316623744/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604275.972861:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3453:1874438316623744:0@lo:400:kworker.0 00010000:00080000:3.0:1787604275.972877:0:3453:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa09f89d90e00 x1874438316624256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604275.972885:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3453:1874438316624256:0@lo:400:kworker.0 00000100:00100000:2.0:1787604275.976629:0:3449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787604275.976765:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0a0c0c04e00 x1874438316622976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787604300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787604275.976779:0:3449:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787604275.976789:0:3449:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1787604275.976799:0:3449:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787604275.976804:0:3449:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787604275.976808:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f884b0000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787604275.977155:0:23233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316623616 00000100:00100000:0.0:1787604275.977165:0:23233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316623616 00000100:00100000:0.0:1787604275.977212:0:23233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787604275.977221:0:23233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3449:x1874438316623616:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787604275.977253:0:23233:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 656 last 0 00000020:00000080:0.0:1787604275.977282:0:23233:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6c241a9cc41dd549 00002000:00100000:0.0:1787604275.977303:0:23233:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffffa09f8214b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1787604275.977308:0:23233:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1787604275.977311:0:23233:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787604275.977407:0:23233:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1787604275.977434:0:23233:0:(import.c:65:import_set_state_nolock()) ffffa0a087ce3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787604275.977511:0:23233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3449:x1874438316623616:12345-0@lo:8:kworker.0 Request processed in 289us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604275.977527:0:23233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000004:00080000:2.0:1787604275.977867:0:3449:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787604275.977875:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316622976:0@lo:8:kworker.0 00000004:00080000:2.0:1787604275.977934:0:21945:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:2.0:1787604275.977955:0:21945:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89353100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:21945:1874438316624512:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787604275.977991:0:21945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604275.978012:0:21945:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a088b30000 going to sleep for 11 seconds 00000100:00100000:2.0:1787604275.978028:0:23234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316624512 00000100:00100000:2.0:1787604275.978032:0:23234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316624512 00000100:00100000:2.0:1787604275.978068:0:23234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787604275.978076:0:23234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:21945:x1874438316624512:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787604275.979113:0:21944:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787604275.979507:0:21944:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 656116819094ns, next at 0ns, rc = 0 00000100:00080000:0.0:1787604275.981868:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787604275.981885:0:3451:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787604275.981919:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316624384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787604275.981995:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604275.983375:0:23236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316624384 00000100:00100000:3.0:1787604275.983387:0:23236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316624384 00000100:00100000:3.0:1787604275.983434:0:23236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787604275.983444:0:23236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc759f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3451:x1874438316624384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787604275.983479:0:23236:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787604275.987122:0:23236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc759f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3451:x1874438316624384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3673us (5120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604275.987146:0:23236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787604275.990972:0:3451:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa09f89350380 x1874438316624384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787604291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604275.991001:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316624384:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1787604275.993166:0:23234:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1787604275.993177:0:23234:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:2.0:1787604275.993183:0:23234:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:65) 00010000:00080000:0.0:1787604275.997200:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0a0c0c07800 x1874438316623104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787604300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604275.997216:0:3449:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787604275.997226:0:3449:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1787604275.997234:0:3449:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787604275.997240:0:3449:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787604275.997243:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa0a0bca77000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787604275.997262:0:3449:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787604275.997267:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3449:1874438316623104:0@lo:8:kworker.0 00000004:00080000:0.0:1787604275.997310:0:21947:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:0.0:1787604275.997329:0:21947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bc75aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:21947:1874438316624768:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787604275.997382:0:21947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604275.997419:0:21947:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0812edd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787604275.997435:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787604275.997446:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bc75a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3450:1874438316624640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787604275.997471:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604275.997511:0:23233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316624768 00000100:00100000:0.0:1787604275.998626:0:23233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316624768 00000100:00100000:0.0:1787604275.998987:0:23233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787604275.999001:0:23233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc75ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:21947:x1874438316624768:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787604276.008581:0:21946:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787604276.010038:0:21946:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 656147349899ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787604276.010985:0:23236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316624640 00000100:00100000:0.0:1787604276.010998:0:23236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316624640 00000100:00100000:0.0:1787604276.011048:0:23236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787604276.011058:0:23236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc759c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3450:x1874438316624640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787604276.011091:0:23236:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787604276.011176:0:23236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc759c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3450:x1874438316624640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (13702us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604276.011183:0:23236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787604276.011203:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787604276.011255:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0a0bc75a680 x1874438316624640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787604291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604276.011276:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bc75a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3450:1874438316624640:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787604276.011314:0:3449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa09f89d93100 x1874438316623616/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787604300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787604276.011338:0:3449:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1787604276.011345:0:3449:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787604276.011351:0:3449:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787604276.011354:0:3449:0:(import.c:65:import_set_state_nolock()) ffffa09f889a1000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787604276.011389:0:3449:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787604276.011396:0:3449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3449:1874438316623616:0@lo:8:kworker.0 00002000:00080000:0.0:1787604276.015119:0:23233:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1787604276.015130:0:23233:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1787604276.015136:0:23233:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00000004:00080000:2.0:1787604276.016195:0:22570:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787604276.016225:0:22570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89352a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22570:1874438316625024:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1787604276.016306:0:22570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604276.016334:0:22570:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a088b30240 going to sleep for 11 seconds 00000004:00080000:2.0:1787604276.016354:0:22569:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787604276.016803:0:22569:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 656154115920ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787604276.016828:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89350e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316624896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787604276.016859:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604276.016902:0:23736:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1787604276.016909:0:23736:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1787604276.017194:0:23236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316624896 00000100:00100000:2.0:1787604276.017201:0:23236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316624896 00000100:00100000:2.0:1787604276.017251:0:23236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787604276.017260:0:23236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3452:x1874438316624896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787604276.017280:0:23236:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787604276.017324:0:23236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3452:x1874438316624896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604276.017331:0:23236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787604276.017667:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787604276.018037:0:3452:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa09f89350e00 x1874438316624896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787604292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787604276.018055:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89350e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316624896:0@lo:13:osp-pre-1-1.0 00002000:00010000:2.0:1787604276.029277:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604276.029292:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b5c3784/0x6c241a9cc41dd550 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.029308:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1787604276.029313:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604276.029320:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b5c3784/0x6c241a9cc41dd550 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.029345:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b5c3784/0x6c241a9cc41dd550 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.029356:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b5c3784/0x6c241a9cc41dd550 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.029364:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b5c3784/0x6c241a9cc41dd550 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.029385:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787604276.029399:0:21908:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604276.029404:0:21908:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b5c3784/0x6c241a9cc41dd550 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.029412:0:21908:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc44e800 already unused, calling callback (ffffffffc175e230) 00010000:00010000:2.0:1787604276.029416:0:21908:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b5c3784/0x6c241a9cc41dd550 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.029424:0:21908:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b5c3784/0x6c241a9cc41dd550 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.029441:0:21908:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b5c3784/0x6c241a9cc41dd550 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.029447:0:21908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b5c3784/0x6c241a9cc41dd550 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.029473:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.029475:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.029477:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787604276.039370:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604276.039384:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2acf611/0x6c241a9cc41dd557 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.039402:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1787604276.039407:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604276.039414:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2acf611/0x6c241a9cc41dd557 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.039430:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2acf611/0x6c241a9cc41dd557 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.039441:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2acf611/0x6c241a9cc41dd557 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.039449:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2acf611/0x6c241a9cc41dd557 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.039470:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787604276.041017:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787604276.041029:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2acf611/0x6c241a9cc41dd557 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.041050:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc44f600 already unused, calling callback (ffffffffc175e230) 00010000:00010000:1.0:1787604276.041055:0:21909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2acf611/0x6c241a9cc41dd557 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.041067:0:21909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2acf611/0x6c241a9cc41dd557 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.041090:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2acf611/0x6c241a9cc41dd557 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.041097:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2acf611/0x6c241a9cc41dd557 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.041116:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604276.041118:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604276.041120:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604276.043679:0:23736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316625024 00000100:00100000:2.0:1787604276.043788:0:23736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316625024 00002000:00010000:2.0:1787604276.044332:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604276.044341:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081fe4cbc/0x6c241a9cc41dd55e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.044363:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1787604276.044368:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604276.044374:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081fe4cbc/0x6c241a9cc41dd55e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.044389:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081fe4cbc/0x6c241a9cc41dd55e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.044399:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081fe4cbc/0x6c241a9cc41dd55e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.044407:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081fe4cbc/0x6c241a9cc41dd55e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.044427:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787604276.044439:0:22982:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604276.044445:0:22982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081fe4cbc/0x6c241a9cc41dd55e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.044453:0:22982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc44fc00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:2.0:1787604276.044459:0:22982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081fe4cbc/0x6c241a9cc41dd55e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.044468:0:22982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081fe4cbc/0x6c241a9cc41dd55e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.044508:0:22982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081fe4cbc/0x6c241a9cc41dd55e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.048489:0:22982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081fe4cbc/0x6c241a9cc41dd55e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604276.049420:0:24115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787604276.049437:0:24115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:22570:x1874438316625024:12345-0@lo:7:osp-pre-1-1.0 00010000:00010000:2.0:1787604276.049964:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.049966:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.049969:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604276.050582:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.050590:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065a46fc3/0x6c241a9cc41dd565 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.050935:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.050940:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.050947:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065a46fc3/0x6c241a9cc41dd565 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.050965:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065a46fc3/0x6c241a9cc41dd565 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.050975:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065a46fc3/0x6c241a9cc41dd565 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.050983:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065a46fc3/0x6c241a9cc41dd565 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.051000:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787604276.052047:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.052057:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000db6591f/0x6c241a9cc41dd56c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.052081:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.052085:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.052090:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000db6591f/0x6c241a9cc41dd56c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.052103:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000db6591f/0x6c241a9cc41dd56c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.052112:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000db6591f/0x6c241a9cc41dd56c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.052121:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000db6591f/0x6c241a9cc41dd56c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.052143:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787604276.052156:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787604276.052162:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065a46fc3/0x6c241a9cc41dd565 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.052171:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09f89d23800 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604276.052176:0:21909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065a46fc3/0x6c241a9cc41dd565 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.052184:0:21909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065a46fc3/0x6c241a9cc41dd565 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.052211:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065a46fc3/0x6c241a9cc41dd565 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.052218:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065a46fc3/0x6c241a9cc41dd565 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.052234:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604276.052304:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000db6591f/0x6c241a9cc41dd56c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.052372:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09f89d23c00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604276.052376:0:21909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000db6591f/0x6c241a9cc41dd56c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.052383:0:21909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000db6591f/0x6c241a9cc41dd56c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.052393:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000db6591f/0x6c241a9cc41dd56c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.052399:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000db6591f/0x6c241a9cc41dd56c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.052411:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.052412:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.052420:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604276.053445:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.053456:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4915bf1/0x6c241a9cc41dd573 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.053469:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.053474:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.053480:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4915bf1/0x6c241a9cc41dd573 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.053502:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4915bf1/0x6c241a9cc41dd573 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.053512:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4915bf1/0x6c241a9cc41dd573 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.053521:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4915bf1/0x6c241a9cc41dd573 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.053541:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787604276.054187:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.054196:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068d5267e/0x6c241a9cc41dd57a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.054205:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.054209:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.054213:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068d5267e/0x6c241a9cc41dd57a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.054236:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068d5267e/0x6c241a9cc41dd57a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.054375:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068d5267e/0x6c241a9cc41dd57a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.054384:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068d5267e/0x6c241a9cc41dd57a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.054402:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787604276.054413:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787604276.054418:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4915bf1/0x6c241a9cc41dd573 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.054426:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09f89d23600 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604276.054430:0:21909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4915bf1/0x6c241a9cc41dd573 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.054439:0:21909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4915bf1/0x6c241a9cc41dd573 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.054454:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4915bf1/0x6c241a9cc41dd573 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.054462:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4915bf1/0x6c241a9cc41dd573 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.054682:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604276.054845:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068d5267e/0x6c241a9cc41dd57a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.054853:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09f89d22000 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604276.054857:0:21909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068d5267e/0x6c241a9cc41dd57a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.054865:0:21909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068d5267e/0x6c241a9cc41dd57a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.054876:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068d5267e/0x6c241a9cc41dd57a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.054884:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068d5267e/0x6c241a9cc41dd57a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.054898:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.054900:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.054902:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604276.055945:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.055955:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090145122/0x6c241a9cc41dd581 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.055968:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.055979:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.055985:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090145122/0x6c241a9cc41dd581 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.055998:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090145122/0x6c241a9cc41dd581 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.056007:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090145122/0x6c241a9cc41dd581 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.056015:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090145122/0x6c241a9cc41dd581 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.056034:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604276.056047:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604276.056052:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090145122/0x6c241a9cc41dd581 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.056059:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0c207ca00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604276.056063:0:21909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090145122/0x6c241a9cc41dd581 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.056071:0:21909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090145122/0x6c241a9cc41dd581 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.056085:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090145122/0x6c241a9cc41dd581 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.056105:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090145122/0x6c241a9cc41dd581 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.056125:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.056128:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.056130:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604276.056945:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.056953:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d8033b2/0x6c241a9cc41dd588 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.056964:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1787604276.056965:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.056969:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.056975:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d8033b2/0x6c241a9cc41dd588 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.056987:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d8033b2/0x6c241a9cc41dd588 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.056996:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d8033b2/0x6c241a9cc41dd588 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.057005:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d8033b2/0x6c241a9cc41dd588 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.057024:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604276.057035:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604276.057046:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d8033b2/0x6c241a9cc41dd588 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.057053:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0c207dc00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604276.057057:0:21909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d8033b2/0x6c241a9cc41dd588 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.057064:0:21909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d8033b2/0x6c241a9cc41dd588 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.057076:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d8033b2/0x6c241a9cc41dd588 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.057084:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d8033b2/0x6c241a9cc41dd588 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.057100:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.057101:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.057103:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.057198:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604276.058038:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.058045:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e951912/0x6c241a9cc41dd58f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.058056:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.058060:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.058064:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e951912/0x6c241a9cc41dd58f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.058086:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e951912/0x6c241a9cc41dd58f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.058096:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e951912/0x6c241a9cc41dd58f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.058103:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e951912/0x6c241a9cc41dd58f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.058120:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787604276.058879:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.058887:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5a250fb/0x6c241a9cc41dd596 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.058896:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.058899:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.058904:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5a250fb/0x6c241a9cc41dd596 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.058913:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5a250fb/0x6c241a9cc41dd596 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.058921:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5a250fb/0x6c241a9cc41dd596 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.058938:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5a250fb/0x6c241a9cc41dd596 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.058971:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787604276.058980:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787604276.058986:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e951912/0x6c241a9cc41dd58f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.058993:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0b73bfa00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604276.058997:0:21909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e951912/0x6c241a9cc41dd58f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.059005:0:21909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e951912/0x6c241a9cc41dd58f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.059019:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e951912/0x6c241a9cc41dd58f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.059026:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e951912/0x6c241a9cc41dd58f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.059043:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604276.059048:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5a250fb/0x6c241a9cc41dd596 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.059065:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0b73bf200 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604276.059069:0:21909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5a250fb/0x6c241a9cc41dd596 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.059076:0:21909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5a250fb/0x6c241a9cc41dd596 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.059089:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5a250fb/0x6c241a9cc41dd596 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.059096:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5a250fb/0x6c241a9cc41dd596 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.059114:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.059116:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.059118:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604276.059919:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.059927:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee70d6ca/0x6c241a9cc41dd59d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.059937:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.059941:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.059946:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee70d6ca/0x6c241a9cc41dd59d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.059956:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee70d6ca/0x6c241a9cc41dd59d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.059971:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee70d6ca/0x6c241a9cc41dd59d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.059978:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee70d6ca/0x6c241a9cc41dd59d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.059992:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787604276.060518:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.060525:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009088991f/0x6c241a9cc41dd5a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.060535:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.060538:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.060541:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009088991f/0x6c241a9cc41dd5a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.060549:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009088991f/0x6c241a9cc41dd5a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.060556:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009088991f/0x6c241a9cc41dd5a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.060562:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009088991f/0x6c241a9cc41dd5a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.060589:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787604276.060603:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787604276.060608:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee70d6ca/0x6c241a9cc41dd59d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.060615:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0b73be200 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604276.060619:0:21909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee70d6ca/0x6c241a9cc41dd59d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.060626:0:21909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee70d6ca/0x6c241a9cc41dd59d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.060639:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee70d6ca/0x6c241a9cc41dd59d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.060646:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee70d6ca/0x6c241a9cc41dd59d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.060663:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604276.060666:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009088991f/0x6c241a9cc41dd5a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.060671:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0b73bf400 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604276.060674:0:21909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009088991f/0x6c241a9cc41dd5a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.060850:0:21909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009088991f/0x6c241a9cc41dd5a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.060861:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009088991f/0x6c241a9cc41dd5a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.060868:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009088991f/0x6c241a9cc41dd5a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.060882:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.060884:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.060885:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.061020:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.061146:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604276.061524:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.061531:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000875b63df/0x6c241a9cc41dd5ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.061541:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.061544:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.061548:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000875b63df/0x6c241a9cc41dd5ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.061557:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000875b63df/0x6c241a9cc41dd5ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.061565:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000875b63df/0x6c241a9cc41dd5ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.061578:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000875b63df/0x6c241a9cc41dd5ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.061591:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604276.061601:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604276.061606:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000875b63df/0x6c241a9cc41dd5ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.061614:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0b73bee00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604276.061617:0:21909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000875b63df/0x6c241a9cc41dd5ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.061626:0:21909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000875b63df/0x6c241a9cc41dd5ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.061637:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000875b63df/0x6c241a9cc41dd5ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.061645:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000875b63df/0x6c241a9cc41dd5ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.061665:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.061667:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.061669:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604276.062482:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.062510:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c1f8330/0x6c241a9cc41dd5b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.062522:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.062526:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.062531:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c1f8330/0x6c241a9cc41dd5b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.062541:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c1f8330/0x6c241a9cc41dd5b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.062550:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c1f8330/0x6c241a9cc41dd5b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.062557:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c1f8330/0x6c241a9cc41dd5b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.062575:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787604276.063144:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.063152:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090d7ee5e/0x6c241a9cc41dd5b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.063161:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.063163:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.063168:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090d7ee5e/0x6c241a9cc41dd5b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.063177:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090d7ee5e/0x6c241a9cc41dd5b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.063195:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090d7ee5e/0x6c241a9cc41dd5b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.063202:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090d7ee5e/0x6c241a9cc41dd5b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.063220:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787604276.063886:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.063893:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8b4c66f/0x6c241a9cc41dd5c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.063903:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.063906:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.063911:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8b4c66f/0x6c241a9cc41dd5c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.063921:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8b4c66f/0x6c241a9cc41dd5c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.063929:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8b4c66f/0x6c241a9cc41dd5c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.063937:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8b4c66f/0x6c241a9cc41dd5c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.063962:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787604276.063978:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787604276.063984:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c1f8330/0x6c241a9cc41dd5b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.063992:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0b73bfe00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604276.063996:0:21909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c1f8330/0x6c241a9cc41dd5b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.064005:0:21909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c1f8330/0x6c241a9cc41dd5b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.064021:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c1f8330/0x6c241a9cc41dd5b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.064028:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c1f8330/0x6c241a9cc41dd5b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.064032:0:22982:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787604276.064042:0:22982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090d7ee5e/0x6c241a9cc41dd5b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.064050:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604276.064052:0:22982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0b73bfc00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604276.064055:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8b4c66f/0x6c241a9cc41dd5c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.064058:0:22982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090d7ee5e/0x6c241a9cc41dd5b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.064072:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0b73be600 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604276.064079:0:21909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8b4c66f/0x6c241a9cc41dd5c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.064080:0:22982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090d7ee5e/0x6c241a9cc41dd5b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.064102:0:22982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090d7ee5e/0x6c241a9cc41dd5b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.064119:0:22982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090d7ee5e/0x6c241a9cc41dd5b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.064133:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.064135:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.064137:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.064445:0:21909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8b4c66f/0x6c241a9cc41dd5c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.064456:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8b4c66f/0x6c241a9cc41dd5c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.064464:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8b4c66f/0x6c241a9cc41dd5c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.064478:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.064479:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.064481:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604276.065217:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.065225:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ed5b4c9/0x6c241a9cc41dd5c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.065236:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.065506:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.065512:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ed5b4c9/0x6c241a9cc41dd5c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.065525:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ed5b4c9/0x6c241a9cc41dd5c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.065535:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ed5b4c9/0x6c241a9cc41dd5c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.065550:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ed5b4c9/0x6c241a9cc41dd5c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.065571:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787604276.066208:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.066217:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c608c0a/0x6c241a9cc41dd5ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.066227:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.066231:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.066371:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c608c0a/0x6c241a9cc41dd5ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.066386:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c608c0a/0x6c241a9cc41dd5ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.066396:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c608c0a/0x6c241a9cc41dd5ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.066404:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c608c0a/0x6c241a9cc41dd5ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.066421:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787604276.066432:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787604276.066437:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ed5b4c9/0x6c241a9cc41dd5c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.066452:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0b73bf800 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604276.066456:0:21909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ed5b4c9/0x6c241a9cc41dd5c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.066464:0:21909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ed5b4c9/0x6c241a9cc41dd5c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.066479:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ed5b4c9/0x6c241a9cc41dd5c7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.066487:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ed5b4c9/0x6c241a9cc41dd5c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.066519:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604276.066522:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c608c0a/0x6c241a9cc41dd5ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.066529:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0b73bea00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604276.066533:0:21909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c608c0a/0x6c241a9cc41dd5ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.066541:0:21909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c608c0a/0x6c241a9cc41dd5ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.066552:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c608c0a/0x6c241a9cc41dd5ce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.066567:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c608c0a/0x6c241a9cc41dd5ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.066584:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.066586:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.066589:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604276.067425:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.067433:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fecf557/0x6c241a9cc41dd5d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.067445:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.067450:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.067455:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fecf557/0x6c241a9cc41dd5d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787604276.067463:0:6460:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1787604276.067468:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fecf557/0x6c241a9cc41dd5d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.067478:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fecf557/0x6c241a9cc41dd5d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.067486:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fecf557/0x6c241a9cc41dd5d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.067515:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1787604276.069752:0:24115:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1787604276.069763:0:24115:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1787604276.069874:0:24115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:22570:x1874438316625024:12345-0@lo:7:osp-pre-1-1.0 Request processed in 20438us (53564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604276.069884:0:24115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1787604276.070474:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604276.070504:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fecf557/0x6c241a9cc41dd5d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.070517:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0b73be400 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604276.070522:0:21909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fecf557/0x6c241a9cc41dd5d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.070532:0:21909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fecf557/0x6c241a9cc41dd5d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.070553:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fecf557/0x6c241a9cc41dd5d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.070560:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fecf557/0x6c241a9cc41dd5d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.070581:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.070583:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.070586:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604276.071284:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.071292:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce86525c/0x6c241a9cc41dd5dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.071751:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.072816:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.072825:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.072835:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce86525c/0x6c241a9cc41dd5dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.072868:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce86525c/0x6c241a9cc41dd5dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.072879:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce86525c/0x6c241a9cc41dd5dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.072888:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce86525c/0x6c241a9cc41dd5dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.072901:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787604276.073115:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604276.073124:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f8b39cb/0x6c241a9cc41dd5e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.073136:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1787604276.073140:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604276.073145:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f8b39cb/0x6c241a9cc41dd5e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.073158:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f8b39cb/0x6c241a9cc41dd5e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.073167:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f8b39cb/0x6c241a9cc41dd5e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.073175:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f8b39cb/0x6c241a9cc41dd5e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.073199:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787604276.073207:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787604276.073214:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce86525c/0x6c241a9cc41dd5dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.073222:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0b73bf600 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604276.073227:0:21909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce86525c/0x6c241a9cc41dd5dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.073236:0:21909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce86525c/0x6c241a9cc41dd5dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.073264:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce86525c/0x6c241a9cc41dd5dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.073272:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce86525c/0x6c241a9cc41dd5dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.073302:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1787604276.073596:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604276.073603:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099b36997/0x6c241a9cc41dd5ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.073622:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1787604276.073625:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604276.073630:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099b36997/0x6c241a9cc41dd5ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.073640:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099b36997/0x6c241a9cc41dd5ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.073648:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099b36997/0x6c241a9cc41dd5ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.073656:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099b36997/0x6c241a9cc41dd5ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.073671:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787604276.073681:0:21908:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787604276.073706:0:21908:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099b36997/0x6c241a9cc41dd5ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.073714:0:21908:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a080030200 already unused, calling callback (ffffffffc175e230) 00010000:00010000:3.0:1787604276.073718:0:21908:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099b36997/0x6c241a9cc41dd5ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.073727:0:21908:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099b36997/0x6c241a9cc41dd5ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.073748:0:21908:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099b36997/0x6c241a9cc41dd5ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.073755:0:21908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099b36997/0x6c241a9cc41dd5ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.073768:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604276.073770:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604276.073772:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787604276.074137:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604276.074143:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd5f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.074151:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1787604276.074154:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604276.074158:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd5f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.074166:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd5f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.074174:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd5f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.074181:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd5f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.074204:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787604276.074212:0:21908:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787604276.074217:0:21908:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd5f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.074223:0:21908:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a080031e00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:3.0:1787604276.074227:0:21908:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd5f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.074231:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f8b39cb/0x6c241a9cc41dd5e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.074238:0:21908:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd5f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.074259:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a080030e00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:3.0:1787604276.074260:0:21908:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd5f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.074265:0:21909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f8b39cb/0x6c241a9cc41dd5e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.074275:0:21908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd5f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.074279:0:21909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f8b39cb/0x6c241a9cc41dd5e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.074299:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604276.074302:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.074303:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f8b39cb/0x6c241a9cc41dd5e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.074304:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.074323:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f8b39cb/0x6c241a9cc41dd5e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.074342:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.074344:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.074346:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604276.074621:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.074628:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059f98703/0x6c241a9cc41dd5f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.074635:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.074646:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.074650:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059f98703/0x6c241a9cc41dd5f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.074659:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059f98703/0x6c241a9cc41dd5f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.074666:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059f98703/0x6c241a9cc41dd5f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.074674:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059f98703/0x6c241a9cc41dd5f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.074716:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787604276.075179:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.075186:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049a604f3/0x6c241a9cc41dd5ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.075195:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.075197:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.075202:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049a604f3/0x6c241a9cc41dd5ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.075212:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049a604f3/0x6c241a9cc41dd5ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.075220:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049a604f3/0x6c241a9cc41dd5ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.075236:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049a604f3/0x6c241a9cc41dd5ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.075252:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787604276.075261:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787604276.075266:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059f98703/0x6c241a9cc41dd5f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.075273:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0b73be800 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604276.075276:0:21909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059f98703/0x6c241a9cc41dd5f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.075284:0:21909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059f98703/0x6c241a9cc41dd5f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.075298:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059f98703/0x6c241a9cc41dd5f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.075305:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059f98703/0x6c241a9cc41dd5f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.075321:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604276.075324:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049a604f3/0x6c241a9cc41dd5ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.075343:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0b73be000 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604276.075347:0:21909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049a604f3/0x6c241a9cc41dd5ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.075355:0:21909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049a604f3/0x6c241a9cc41dd5ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.075366:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049a604f3/0x6c241a9cc41dd5ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.075373:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049a604f3/0x6c241a9cc41dd5ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.075388:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.075391:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.075392:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604276.075863:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.075870:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a91abd4/0x6c241a9cc41dd606 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.075879:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.075882:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.075887:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a91abd4/0x6c241a9cc41dd606 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.075897:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a91abd4/0x6c241a9cc41dd606 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.075914:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a91abd4/0x6c241a9cc41dd606 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.075920:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a91abd4/0x6c241a9cc41dd606 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.075941:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604276.075949:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604276.075953:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a91abd4/0x6c241a9cc41dd606 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.075960:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0b73bf000 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604276.075963:0:21909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a91abd4/0x6c241a9cc41dd606 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.075971:0:21909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a91abd4/0x6c241a9cc41dd606 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.075982:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a91abd4/0x6c241a9cc41dd606 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.075989:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a91abd4/0x6c241a9cc41dd606 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.076005:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.076014:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.076016:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604276.076450:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.076456:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce1c8120/0x6c241a9cc41dd60d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.076463:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.076466:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.076470:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce1c8120/0x6c241a9cc41dd60d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.076478:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce1c8120/0x6c241a9cc41dd60d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.076485:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce1c8120/0x6c241a9cc41dd60d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.077414:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce1c8120/0x6c241a9cc41dd60d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.077447:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787604276.078438:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787604276.078448:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce1c8120/0x6c241a9cc41dd60d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.078467:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0b73bec00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:1.0:1787604276.078472:0:21909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce1c8120/0x6c241a9cc41dd60d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.078483:0:21909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce1c8120/0x6c241a9cc41dd60d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.078514:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce1c8120/0x6c241a9cc41dd60d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.078522:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce1c8120/0x6c241a9cc41dd60d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.078548:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604276.078550:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604276.078552:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604276.078639:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.078646:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000028c7482/0x6c241a9cc41dd614 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.078658:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.078662:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.078668:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000028c7482/0x6c241a9cc41dd614 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.078838:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000028c7482/0x6c241a9cc41dd614 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.078850:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000028c7482/0x6c241a9cc41dd614 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.078858:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000028c7482/0x6c241a9cc41dd614 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.078880:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787604276.078889:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787604276.078896:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000028c7482/0x6c241a9cc41dd614 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.078904:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc41ae00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:1.0:1787604276.078908:0:21909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000028c7482/0x6c241a9cc41dd614 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.078916:0:21909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000028c7482/0x6c241a9cc41dd614 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.078936:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000028c7482/0x6c241a9cc41dd614 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.078944:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000028c7482/0x6c241a9cc41dd614 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.078962:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604276.078964:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604276.078966:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604276.079513:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.079521:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d66cc559/0x6c241a9cc41dd61b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.079530:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.079533:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.079538:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d66cc559/0x6c241a9cc41dd61b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.079547:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d66cc559/0x6c241a9cc41dd61b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.079556:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d66cc559/0x6c241a9cc41dd61b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.079574:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d66cc559/0x6c241a9cc41dd61b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.079596:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787604276.079604:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787604276.079611:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d66cc559/0x6c241a9cc41dd61b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.079620:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc41b600 already unused, calling callback (ffffffffc175e230) 00010000:00010000:1.0:1787604276.079625:0:21909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d66cc559/0x6c241a9cc41dd61b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.079633:0:21909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d66cc559/0x6c241a9cc41dd61b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.079646:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d66cc559/0x6c241a9cc41dd61b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.079654:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d66cc559/0x6c241a9cc41dd61b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.079682:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604276.079719:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604276.079721:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604276.080409:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.080416:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b33d21c/0x6c241a9cc41dd622 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.080426:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.080429:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.080434:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b33d21c/0x6c241a9cc41dd622 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.080444:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b33d21c/0x6c241a9cc41dd622 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.080453:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b33d21c/0x6c241a9cc41dd622 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.080460:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b33d21c/0x6c241a9cc41dd622 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.080479:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787604276.081036:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.081043:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a4f1dc0/0x6c241a9cc41dd629 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.081060:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.081063:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.081067:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a4f1dc0/0x6c241a9cc41dd629 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.081076:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a4f1dc0/0x6c241a9cc41dd629 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.081085:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a4f1dc0/0x6c241a9cc41dd629 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.081092:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a4f1dc0/0x6c241a9cc41dd629 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.081101:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787604276.081890:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.081897:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d19a4718/0x6c241a9cc41dd630 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.081907:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.081910:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.081916:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d19a4718/0x6c241a9cc41dd630 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.081928:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d19a4718/0x6c241a9cc41dd630 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.081947:0:22982:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787604276.081951:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d19a4718/0x6c241a9cc41dd630 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.081956:0:22982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b33d21c/0x6c241a9cc41dd622 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.081962:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d19a4718/0x6c241a9cc41dd630 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.081975:0:22982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc41a800 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604276.081980:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787604276.081981:0:22982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b33d21c/0x6c241a9cc41dd622 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.081992:0:22982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b33d21c/0x6c241a9cc41dd622 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.082009:0:22982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b33d21c/0x6c241a9cc41dd622 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.082016:0:22982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b33d21c/0x6c241a9cc41dd622 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.082035:0:22982:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787604276.082039:0:22982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a4f1dc0/0x6c241a9cc41dd629 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.082054:0:22982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc41a200 already unused, calling callback (ffffffffc175e230) 00010000:00010000:2.0:1787604276.082058:0:22982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a4f1dc0/0x6c241a9cc41dd629 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.082066:0:22982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a4f1dc0/0x6c241a9cc41dd629 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.082079:0:22982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a4f1dc0/0x6c241a9cc41dd629 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.082086:0:22982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a4f1dc0/0x6c241a9cc41dd629 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.082101:0:22982:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604276.082105:0:22982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d19a4718/0x6c241a9cc41dd630 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.082111:0:22982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc41aa00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:2.0:1787604276.082114:0:22982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d19a4718/0x6c241a9cc41dd630 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.082122:0:22982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d19a4718/0x6c241a9cc41dd630 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.082132:0:22982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d19a4718/0x6c241a9cc41dd630 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.082145:0:22982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d19a4718/0x6c241a9cc41dd630 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.082159:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.082161:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.082163:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604276.082342:0:22570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89352a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22570:1874438316625024:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1787604276.082357:0:22570:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1787604276.082400:0:22570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89352a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22570:1874438316625152:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1787604276.082464:0:22570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604276.082502:0:22570:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0bf0c9180 going to sleep for 11 seconds 00002000:00010000:0.0:1787604276.082959:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.082967:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003eecffc6/0x6c241a9cc41dd637 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.082977:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.082981:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.082987:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003eecffc6/0x6c241a9cc41dd637 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.082997:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003eecffc6/0x6c241a9cc41dd637 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.083005:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003eecffc6/0x6c241a9cc41dd637 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.083013:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003eecffc6/0x6c241a9cc41dd637 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.083043:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604276.083054:0:22982:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604276.083058:0:22982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003eecffc6/0x6c241a9cc41dd637 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.083065:0:22982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc41b000 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604276.083068:0:22982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003eecffc6/0x6c241a9cc41dd637 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.083076:0:22982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003eecffc6/0x6c241a9cc41dd637 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.083089:0:22982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003eecffc6/0x6c241a9cc41dd637 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.083096:0:22982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003eecffc6/0x6c241a9cc41dd637 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.083111:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.083112:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.083114:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604276.083930:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604276.084130:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.084139:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000837bdb5c/0x6c241a9cc41dd63e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.084212:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.084224:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.084229:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000837bdb5c/0x6c241a9cc41dd63e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.084380:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000837bdb5c/0x6c241a9cc41dd63e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.084391:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000837bdb5c/0x6c241a9cc41dd63e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.084399:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000837bdb5c/0x6c241a9cc41dd63e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.084418:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604276.084429:0:22982:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604276.084434:0:22982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000837bdb5c/0x6c241a9cc41dd63e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.084442:0:22982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc41b400 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604276.084446:0:22982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000837bdb5c/0x6c241a9cc41dd63e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.084455:0:22982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000837bdb5c/0x6c241a9cc41dd63e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.084469:0:22982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000837bdb5c/0x6c241a9cc41dd63e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.084488:0:22982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000837bdb5c/0x6c241a9cc41dd63e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.084518:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.084520:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.084522:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604276.084558:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787604276.085111:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.085118:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007609c254/0x6c241a9cc41dd645 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.085128:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.085131:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.085136:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007609c254/0x6c241a9cc41dd645 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.085197:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007609c254/0x6c241a9cc41dd645 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.085206:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007609c254/0x6c241a9cc41dd645 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.085214:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007609c254/0x6c241a9cc41dd645 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.085235:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787604276.085921:0:23233:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787604276.085936:0:23233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a0690df/0x6c241a9cc41dd64c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.085947:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1787604276.085951:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604276.085956:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a0690df/0x6c241a9cc41dd64c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.085966:0:23233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a0690df/0x6c241a9cc41dd64c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.085975:0:23233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a0690df/0x6c241a9cc41dd64c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.085982:0:23233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a0690df/0x6c241a9cc41dd64c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.085997:0:23233:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787604276.086006:0:22982:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787604276.086011:0:22982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007609c254/0x6c241a9cc41dd645 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.086019:0:22982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc41ba00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604276.086023:0:22982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007609c254/0x6c241a9cc41dd645 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.086031:0:22982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007609c254/0x6c241a9cc41dd645 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.086052:0:22982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007609c254/0x6c241a9cc41dd645 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.086059:0:22982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007609c254/0x6c241a9cc41dd645 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.086076:0:22982:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604276.086080:0:22982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a0690df/0x6c241a9cc41dd64c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.086087:0:22982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc41a600 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604276.086091:0:22982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a0690df/0x6c241a9cc41dd64c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.086098:0:22982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a0690df/0x6c241a9cc41dd64c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.086107:0:22982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a0690df/0x6c241a9cc41dd64c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.086115:0:22982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a0690df/0x6c241a9cc41dd64c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604276.086128:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.086130:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604276.086204:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787604276.086894:0:23233:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:0.0:1787604276.086991:0:23233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc75ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:21947:x1874438316624768:12345-0@lo:5:osp-pre-1-0.0 Request processed in 87990us (89603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604276.087003:0:23233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787604276.087059:0:21947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bc75aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:21947:1874438316624768:0@lo:5:osp-pre-1-0.0 00002000:00010000:3.0:1787604276.087064:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604276.087074:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcdbefb4/0x6c241a9cc41dd653 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787604276.087075:0:21947:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00010000:00010000:3.0:1787604276.087105:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1787604276.087109:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604276.087115:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcdbefb4/0x6c241a9cc41dd653 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604276.087125:0:21947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bc75aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:21947:1874438316625280:0@lo:5:osp-pre-1-0.0 00010000:00010000:3.0:1787604276.087130:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcdbefb4/0x6c241a9cc41dd653 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.087141:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcdbefb4/0x6c241a9cc41dd653 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.087149:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bcdbefb4/0x6c241a9cc41dd653 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.087166:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787604276.087435:0:21947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604276.087461:0:21947:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0904cd180 going to sleep for 11 seconds 00000100:00100000:0.0:1787604276.087481:0:23235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316625152 00000100:00100000:0.0:1787604276.087488:0:23235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316625152 00000100:00100000:0.0:1787604276.087535:0:23235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316625280 00000100:00100000:0.0:1787604276.087539:0:23235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316625280 00000100:00100000:0.0:1787604276.087559:0:23235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787604276.087568:0:23235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:22570:x1874438316625152:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1787604276.087595:0:23235:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1787604276.087633:0:23235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:22570:x1874438316625152:12345-0@lo:5:osp-pre-1-1.0 Request processed in 66us (5170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604276.087641:0:23235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00002000:00010000:3.0:1787604276.087644:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604276.087652:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd9b2ac1/0x6c241a9cc41dd65a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604276.087656:0:23235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1787604276.087667:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=656s v=(0 0) 00000100:00100000:0.0:1787604276.087667:0:23235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc75a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:21947:x1874438316625280:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:3.0:1787604276.087676:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604276.087681:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd9b2ac1/0x6c241a9cc41dd65a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1787604276.087722:0:23235:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00010000:00010000:2.0:1787604276.087917:0:21908:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604276.087925:0:21908:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bcdbefb4/0x6c241a9cc41dd653 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.087934:0:21908:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a080031800 already unused, calling callback (ffffffffc175e230) 00010000:00010000:2.0:1787604276.087939:0:21908:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcdbefb4/0x6c241a9cc41dd653 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.087948:0:21908:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcdbefb4/0x6c241a9cc41dd653 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.087965:0:21908:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bcdbefb4/0x6c241a9cc41dd653 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.087986:0:21908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcdbefb4/0x6c241a9cc41dd653 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.088005:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.088009:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.088012:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604276.090038:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd9b2ac1/0x6c241a9cc41dd65a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.090067:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd9b2ac1/0x6c241a9cc41dd65a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.090075:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd9b2ac1/0x6c241a9cc41dd65a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.091252:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604276.092106:0:22570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89352a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22570:1874438316625152:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1787604276.092126:0:22570:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00010000:00010000:3.0:1787604276.093340:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787604276.093896:0:22982:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787604276.093905:0:22982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd9b2ac1/0x6c241a9cc41dd65a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.093918:0:22982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a080030c00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:1.0:1787604276.093923:0:22982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd9b2ac1/0x6c241a9cc41dd65a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.093934:0:22982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd9b2ac1/0x6c241a9cc41dd65a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.093953:0:22982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd9b2ac1/0x6c241a9cc41dd65a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.093960:0:22982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd9b2ac1/0x6c241a9cc41dd65a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.093981:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604276.093983:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604276.093985:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787604276.094326:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604276.094334:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004efdf126/0x6c241a9cc41dd661 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.094346:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1787604276.094350:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604276.094357:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004efdf126/0x6c241a9cc41dd661 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.094368:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004efdf126/0x6c241a9cc41dd661 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.094376:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004efdf126/0x6c241a9cc41dd661 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.094383:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004efdf126/0x6c241a9cc41dd661 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.094407:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787604276.094514:0:22570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bc75b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22570:1874438316625408:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1787604276.094591:0:22570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604276.094633:0:22570:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0904cd780 going to sleep for 11 seconds 00010000:00010000:2.0:1787604276.095060:0:21908:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604276.095066:0:21908:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004efdf126/0x6c241a9cc41dd661 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.095075:0:21908:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a080031600 already unused, calling callback (ffffffffc175e230) 00010000:00010000:2.0:1787604276.095079:0:21908:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004efdf126/0x6c241a9cc41dd661 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.095087:0:21908:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004efdf126/0x6c241a9cc41dd661 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.095101:0:21908:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004efdf126/0x6c241a9cc41dd661 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.095108:0:21908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004efdf126/0x6c241a9cc41dd661 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.095124:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.095126:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.095127:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787604276.095542:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604276.095550:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd668 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.095560:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1787604276.095564:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604276.095568:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd668 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.095578:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd668 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.095586:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd668 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.095593:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd668 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.095652:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787604276.095680:0:23736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316625408 00000100:00100000:0.0:1787604276.095738:0:23736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316625408 00000100:00100000:0.0:1787604276.095927:0:23736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787604276.095939:0:23736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc758e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:22570:x1874438316625408:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1787604276.095983:0:23736:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:3.0:1787604276.096133:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604276.096139:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099b36997/0x6c241a9cc41dd66f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.096148:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1787604276.096158:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604276.096162:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099b36997/0x6c241a9cc41dd66f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.096171:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099b36997/0x6c241a9cc41dd66f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.096179:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099b36997/0x6c241a9cc41dd66f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.096186:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099b36997/0x6c241a9cc41dd66f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.101727:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787604276.101747:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd668 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.101760:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a080031e00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:1.0:1787604276.101764:0:21909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd668 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.101776:0:21909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd668 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.101793:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd668 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.101800:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd668 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.101988:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787604276.101993:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099b36997/0x6c241a9cc41dd66f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.102000:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a080030200 already unused, calling callback (ffffffffc175e230) 00010000:00010000:1.0:1787604276.102003:0:21909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099b36997/0x6c241a9cc41dd66f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.102011:0:21909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099b36997/0x6c241a9cc41dd66f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.102032:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099b36997/0x6c241a9cc41dd66f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604276.102040:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604276.102042:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604276.102044:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604276.107656:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787604276.107680:0:23234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099b36997/0x6c241a9cc41dd66f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604276.108454:0:23235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc75a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:21947:x1874438316625280:12345-0@lo:5:osp-pre-1-0.0 Request processed in 20784us (21015us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1787604276.108466:0:23235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787604276.108533:0:21947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bc75aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:21947:1874438316625280:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787604276.108548:0:21947:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00002000:00010000:3.0:1787604276.108607:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604276.108616:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcdbefb4/0x6c241a9cc41dd676 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.108630:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1787604276.108634:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604276.108913:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604276.109350:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcdbefb4/0x6c241a9cc41dd676 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.109365:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcdbefb4/0x6c241a9cc41dd676 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.109383:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcdbefb4/0x6c241a9cc41dd676 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.109391:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bcdbefb4/0x6c241a9cc41dd676 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.109412:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787604276.110080:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604276.110087:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f8b39cb/0x6c241a9cc41dd67d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.110098:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1787604276.110101:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604276.110106:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f8b39cb/0x6c241a9cc41dd67d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.110117:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f8b39cb/0x6c241a9cc41dd67d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.110126:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f8b39cb/0x6c241a9cc41dd67d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.110135:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f8b39cb/0x6c241a9cc41dd67d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.110162:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787604276.110557:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787604276.110563:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000823efbf9/0x6c241a9cc41dd684 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.110571:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1787604276.110575:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604276.110579:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000823efbf9/0x6c241a9cc41dd684 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.110588:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000823efbf9/0x6c241a9cc41dd684 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.110596:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000823efbf9/0x6c241a9cc41dd684 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.110604:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000823efbf9/0x6c241a9cc41dd684 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.110615:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787604276.110844:0:22982:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787604276.110852:0:22982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bcdbefb4/0x6c241a9cc41dd676 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.110860:0:22982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a080031800 already unused, calling callback (ffffffffc175e230) 00010000:00010000:2.0:1787604276.110865:0:22982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcdbefb4/0x6c241a9cc41dd676 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.110874:0:22982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcdbefb4/0x6c241a9cc41dd676 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.110890:0:22982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bcdbefb4/0x6c241a9cc41dd676 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.110896:0:22982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcdbefb4/0x6c241a9cc41dd676 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.110914:0:22982:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787604276.110918:0:22982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f8b39cb/0x6c241a9cc41dd67d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.110924:0:22982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a080030e00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:2.0:1787604276.110927:0:22982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f8b39cb/0x6c241a9cc41dd67d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.110935:0:22982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f8b39cb/0x6c241a9cc41dd67d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.110953:0:22982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f8b39cb/0x6c241a9cc41dd67d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.110959:0:22982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f8b39cb/0x6c241a9cc41dd67d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.110972:0:22982:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604276.110975:0:22982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000823efbf9/0x6c241a9cc41dd684 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.110982:0:22982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a080030a00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:2.0:1787604276.110985:0:22982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000823efbf9/0x6c241a9cc41dd684 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.110991:0:22982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000823efbf9/0x6c241a9cc41dd684 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.111000:0:22982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000823efbf9/0x6c241a9cc41dd684 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.111007:0:22982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000823efbf9/0x6c241a9cc41dd684 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.111018:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.111019:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.111028:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.111054:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787604276.120453:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604276.120465:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081fe4cbc/0x6c241a9cc41dd68b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.120482:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1787604276.120486:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604276.120502:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081fe4cbc/0x6c241a9cc41dd68b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.120517:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081fe4cbc/0x6c241a9cc41dd68b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.120527:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081fe4cbc/0x6c241a9cc41dd68b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.120538:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081fe4cbc/0x6c241a9cc41dd68b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.120559:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787604276.120574:0:22982:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604276.120580:0:22982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081fe4cbc/0x6c241a9cc41dd68b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.120587:0:22982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc44fc00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:2.0:1787604276.120591:0:22982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081fe4cbc/0x6c241a9cc41dd68b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.120612:0:22982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081fe4cbc/0x6c241a9cc41dd68b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.120626:0:22982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081fe4cbc/0x6c241a9cc41dd68b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.120634:0:22982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081fe4cbc/0x6c241a9cc41dd68b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.120649:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.120651:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.120652:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787604276.121306:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604276.121313:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b5c3784/0x6c241a9cc41dd692 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.121323:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1787604276.121327:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604276.121331:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b5c3784/0x6c241a9cc41dd692 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.121340:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b5c3784/0x6c241a9cc41dd692 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.121348:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b5c3784/0x6c241a9cc41dd692 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.121360:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b5c3784/0x6c241a9cc41dd692 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.121374:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787604276.121382:0:21908:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604276.121387:0:21908:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b5c3784/0x6c241a9cc41dd692 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.121393:0:21908:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc44e800 already unused, calling callback (ffffffffc175e230) 00010000:00010000:2.0:1787604276.121397:0:21908:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b5c3784/0x6c241a9cc41dd692 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.121404:0:21908:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b5c3784/0x6c241a9cc41dd692 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.121415:0:21908:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b5c3784/0x6c241a9cc41dd692 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.121421:0:21908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b5c3784/0x6c241a9cc41dd692 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.121433:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.121435:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.121436:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787604276.121936:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604276.121952:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a675b53f/0x6c241a9cc41dd699 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.121961:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1787604276.121964:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604276.121968:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a675b53f/0x6c241a9cc41dd699 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.121978:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a675b53f/0x6c241a9cc41dd699 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.121988:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a675b53f/0x6c241a9cc41dd699 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.121995:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a675b53f/0x6c241a9cc41dd699 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.122011:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787604276.122021:0:22982:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604276.122024:0:22982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a675b53f/0x6c241a9cc41dd699 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.122031:0:22982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc44e600 already unused, calling callback (ffffffffc175e230) 00010000:00010000:2.0:1787604276.122035:0:22982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a675b53f/0x6c241a9cc41dd699 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.122043:0:22982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a675b53f/0x6c241a9cc41dd699 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.122062:0:22982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a675b53f/0x6c241a9cc41dd699 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.122069:0:22982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a675b53f/0x6c241a9cc41dd699 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.122085:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.122086:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.122088:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787604276.122484:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604276.122502:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000531d7a14/0x6c241a9cc41dd6a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.122510:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1787604276.122513:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604276.122516:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000531d7a14/0x6c241a9cc41dd6a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.122525:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000531d7a14/0x6c241a9cc41dd6a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.122533:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000531d7a14/0x6c241a9cc41dd6a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.122540:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000531d7a14/0x6c241a9cc41dd6a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.122567:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787604276.122576:0:21908:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604276.122580:0:21908:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000531d7a14/0x6c241a9cc41dd6a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.122587:0:21908:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc44ee00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:2.0:1787604276.122590:0:21908:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000531d7a14/0x6c241a9cc41dd6a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.122598:0:21908:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000531d7a14/0x6c241a9cc41dd6a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.122608:0:21908:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000531d7a14/0x6c241a9cc41dd6a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.122615:0:21908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000531d7a14/0x6c241a9cc41dd6a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.122628:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.122630:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.122631:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787604276.123036:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604276.123042:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2acf611/0x6c241a9cc41dd6a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.123050:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1787604276.123059:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604276.123063:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2acf611/0x6c241a9cc41dd6a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.123073:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2acf611/0x6c241a9cc41dd6a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.123080:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2acf611/0x6c241a9cc41dd6a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.123086:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2acf611/0x6c241a9cc41dd6a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.123098:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787604276.123105:0:22982:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604276.123108:0:22982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2acf611/0x6c241a9cc41dd6a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.123115:0:22982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc44f600 already unused, calling callback (ffffffffc175e230) 00010000:00010000:2.0:1787604276.123118:0:22982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2acf611/0x6c241a9cc41dd6a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.123124:0:22982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2acf611/0x6c241a9cc41dd6a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.123134:0:22982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2acf611/0x6c241a9cc41dd6a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.123151:0:22982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2acf611/0x6c241a9cc41dd6a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.123165:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.123167:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.123169:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787604276.127487:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604276.127518:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fb01759/0x6c241a9cc41dd6ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.127536:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1787604276.127540:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604276.127547:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fb01759/0x6c241a9cc41dd6ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.127562:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fb01759/0x6c241a9cc41dd6ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.127572:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fb01759/0x6c241a9cc41dd6ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.127580:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fb01759/0x6c241a9cc41dd6ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.127616:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787604276.127633:0:21908:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604276.127648:0:21908:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fb01759/0x6c241a9cc41dd6ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.127657:0:21908:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc44f400 already unused, calling callback (ffffffffc175e230) 00010000:00010000:2.0:1787604276.127663:0:21908:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fb01759/0x6c241a9cc41dd6ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.127672:0:21908:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fb01759/0x6c241a9cc41dd6ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.127722:0:21908:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fb01759/0x6c241a9cc41dd6ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.127730:0:21908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fb01759/0x6c241a9cc41dd6ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.128386:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.128390:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.128392:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787604276.132597:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604276.132611:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037ddf089/0x6c241a9cc41dd6b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.132629:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1787604276.132634:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604276.132641:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037ddf089/0x6c241a9cc41dd6b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.132668:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037ddf089/0x6c241a9cc41dd6b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.132678:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037ddf089/0x6c241a9cc41dd6b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.132713:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037ddf089/0x6c241a9cc41dd6b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.132742:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787604276.132759:0:22982:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604276.132764:0:22982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037ddf089/0x6c241a9cc41dd6b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.132772:0:22982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a083e4b200 already unused, calling callback (ffffffffc175e230) 00010000:00010000:2.0:1787604276.132777:0:22982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037ddf089/0x6c241a9cc41dd6b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.132786:0:22982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037ddf089/0x6c241a9cc41dd6b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.132804:0:22982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037ddf089/0x6c241a9cc41dd6b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.132812:0:22982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037ddf089/0x6c241a9cc41dd6b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.132844:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.132847:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.132849:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787604276.134207:0:7237:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:2.0:1787604276.134887:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604276.134897:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001faae216/0x6c241a9cc41dd6bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.134913:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1787604276.134918:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604276.134924:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001faae216/0x6c241a9cc41dd6bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.134949:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001faae216/0x6c241a9cc41dd6bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.135235:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001faae216/0x6c241a9cc41dd6bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.135323:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001faae216/0x6c241a9cc41dd6bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.135348:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787604276.135644:0:21908:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787604276.135653:0:21908:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001faae216/0x6c241a9cc41dd6bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.135663:0:21908:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a083e4a400 already unused, calling callback (ffffffffc175e230) 00010000:00010000:3.0:1787604276.135708:0:21908:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001faae216/0x6c241a9cc41dd6bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.135720:0:21908:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001faae216/0x6c241a9cc41dd6bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.135738:0:21908:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001faae216/0x6c241a9cc41dd6bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.135747:0:21908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001faae216/0x6c241a9cc41dd6bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.135767:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604276.135769:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604276.135771:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787604276.136075:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604276.136083:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000729c695f/0x6c241a9cc41dd6c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.136218:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1787604276.136224:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604276.136230:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000729c695f/0x6c241a9cc41dd6c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.136317:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000729c695f/0x6c241a9cc41dd6c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.136328:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000729c695f/0x6c241a9cc41dd6c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.136336:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000729c695f/0x6c241a9cc41dd6c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.136362:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787604276.136663:0:22982:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787604276.136669:0:22982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000729c695f/0x6c241a9cc41dd6c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.136716:0:22982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a083e4a600 already unused, calling callback (ffffffffc175e230) 00010000:00010000:3.0:1787604276.136720:0:22982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000729c695f/0x6c241a9cc41dd6c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.136729:0:22982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000729c695f/0x6c241a9cc41dd6c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.136743:0:22982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000729c695f/0x6c241a9cc41dd6c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.136758:0:22982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000729c695f/0x6c241a9cc41dd6c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.136776:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604276.136778:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604276.136779:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787604276.137862:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604276.137872:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d1d7554/0x6c241a9cc41dd6ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.138223:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1787604276.138228:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604276.138234:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d1d7554/0x6c241a9cc41dd6ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.138319:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d1d7554/0x6c241a9cc41dd6ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.138345:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d1d7554/0x6c241a9cc41dd6ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.138352:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d1d7554/0x6c241a9cc41dd6ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.138373:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787604276.138605:0:21908:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787604276.138613:0:21908:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d1d7554/0x6c241a9cc41dd6ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.138622:0:21908:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a083e4b400 already unused, calling callback (ffffffffc175e230) 00010000:00010000:3.0:1787604276.138626:0:21908:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d1d7554/0x6c241a9cc41dd6ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.138634:0:21908:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d1d7554/0x6c241a9cc41dd6ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.138649:0:21908:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d1d7554/0x6c241a9cc41dd6ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.138656:0:21908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d1d7554/0x6c241a9cc41dd6ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.138682:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604276.138698:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604276.138701:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787604276.139357:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604276.139366:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7f6178b/0x6c241a9cc41dd6d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.139377:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1787604276.139380:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604276.139386:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7f6178b/0x6c241a9cc41dd6d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.139396:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7f6178b/0x6c241a9cc41dd6d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.139405:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7f6178b/0x6c241a9cc41dd6d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.139413:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7f6178b/0x6c241a9cc41dd6d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.139451:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787604276.139580:0:22982:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787604276.139586:0:22982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7f6178b/0x6c241a9cc41dd6d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.139594:0:22982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a083e4be00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:3.0:1787604276.139598:0:22982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7f6178b/0x6c241a9cc41dd6d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.139606:0:22982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7f6178b/0x6c241a9cc41dd6d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.139619:0:22982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7f6178b/0x6c241a9cc41dd6d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.139626:0:22982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7f6178b/0x6c241a9cc41dd6d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.139641:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604276.139643:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604276.139646:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787604276.140737:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604276.140747:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006968df45/0x6c241a9cc41dd6d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.140759:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1787604276.140763:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604276.140768:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006968df45/0x6c241a9cc41dd6d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.140780:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006968df45/0x6c241a9cc41dd6d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.140790:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006968df45/0x6c241a9cc41dd6d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.140797:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006968df45/0x6c241a9cc41dd6d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.140811:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787604276.141300:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604276.141308:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029ca4d0b/0x6c241a9cc41dd6df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.141317:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1787604276.141328:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604276.141333:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029ca4d0b/0x6c241a9cc41dd6df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.141344:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029ca4d0b/0x6c241a9cc41dd6df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.141353:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029ca4d0b/0x6c241a9cc41dd6df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.141361:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029ca4d0b/0x6c241a9cc41dd6df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.141379:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787604276.141391:0:22982:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787604276.141397:0:22982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006968df45/0x6c241a9cc41dd6d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.141405:0:22982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a083e4ae00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:2.0:1787604276.141409:0:22982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006968df45/0x6c241a9cc41dd6d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.141418:0:22982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006968df45/0x6c241a9cc41dd6d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.141433:0:22982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006968df45/0x6c241a9cc41dd6d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.141454:0:22982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006968df45/0x6c241a9cc41dd6d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.141472:0:22982:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604276.141475:0:22982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029ca4d0b/0x6c241a9cc41dd6df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.141480:0:22982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a083e4ac00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:2.0:1787604276.141484:0:22982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029ca4d0b/0x6c241a9cc41dd6df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.141863:0:22982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029ca4d0b/0x6c241a9cc41dd6df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.141878:0:22982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029ca4d0b/0x6c241a9cc41dd6df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.141885:0:22982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029ca4d0b/0x6c241a9cc41dd6df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.141898:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.141900:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.141902:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787604276.142667:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604276.142676:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063464f50/0x6c241a9cc41dd6e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.142752:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1787604276.142757:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604276.142766:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063464f50/0x6c241a9cc41dd6e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.142776:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063464f50/0x6c241a9cc41dd6e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.142785:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063464f50/0x6c241a9cc41dd6e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.142792:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063464f50/0x6c241a9cc41dd6e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.142808:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787604276.142816:0:22982:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604276.142820:0:22982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063464f50/0x6c241a9cc41dd6e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.142827:0:22982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a083e4a000 already unused, calling callback (ffffffffc175e230) 00010000:00010000:2.0:1787604276.142831:0:22982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063464f50/0x6c241a9cc41dd6e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.142838:0:22982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063464f50/0x6c241a9cc41dd6e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.142859:0:22982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063464f50/0x6c241a9cc41dd6e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.142866:0:22982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063464f50/0x6c241a9cc41dd6e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.142879:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.142881:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604276.142882:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787604276.143569:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604276.143945:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787604276.144908:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604276.144919:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006968df45/0x6c241a9cc41dd6ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.144934:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1787604276.144951:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604276.145670:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006968df45/0x6c241a9cc41dd6ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.145718:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006968df45/0x6c241a9cc41dd6ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.145730:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006968df45/0x6c241a9cc41dd6ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.145739:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006968df45/0x6c241a9cc41dd6ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.145783:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787604276.146531:0:22982:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787604276.146541:0:22982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006968df45/0x6c241a9cc41dd6ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.146552:0:22982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a083e4ae00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:3.0:1787604276.146556:0:22982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006968df45/0x6c241a9cc41dd6ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.146582:0:22982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006968df45/0x6c241a9cc41dd6ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.146599:0:22982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006968df45/0x6c241a9cc41dd6ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.146606:0:22982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006968df45/0x6c241a9cc41dd6ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.146627:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604276.146629:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604276.146630:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787604276.147722:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604276.147733:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037ddf089/0x6c241a9cc41dd6f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.147746:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1787604276.147751:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604276.147758:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037ddf089/0x6c241a9cc41dd6f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.147772:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037ddf089/0x6c241a9cc41dd6f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.147781:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037ddf089/0x6c241a9cc41dd6f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.147789:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037ddf089/0x6c241a9cc41dd6f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.147807:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787604276.148149:0:23736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc758e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:22570:x1874438316625408:12345-0@lo:5:osp-pre-1-1.0 Request processed in 52208us (53552us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1787604276.148160:0:23736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00002000:00010000:2.0:1787604276.148256:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604276.148263:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d216add0/0x6c241a9cc41dd6fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.148272:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1787604276.148282:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604276.148287:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d216add0/0x6c241a9cc41dd6fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.148297:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d216add0/0x6c241a9cc41dd6fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.148306:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d216add0/0x6c241a9cc41dd6fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.148314:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d216add0/0x6c241a9cc41dd6fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.148336:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787604276.148632:0:21908:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1787604276.148639:0:22570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bc75b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22570:1874438316625408:0@lo:5:osp-pre-1-1.0 00010000:00010000:3.0:1787604276.148640:0:21908:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037ddf089/0x6c241a9cc41dd6f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.148649:0:21908:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a083e4b200 already unused, calling callback (ffffffffc175e230) 00010000:00010000:3.0:1787604276.148653:0:21908:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037ddf089/0x6c241a9cc41dd6f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787604276.148654:0:22570:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00010000:00010000:3.0:1787604276.148661:0:21908:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037ddf089/0x6c241a9cc41dd6f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.148682:0:21908:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037ddf089/0x6c241a9cc41dd6f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.148727:0:21908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037ddf089/0x6c241a9cc41dd6f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604276.148729:0:22570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bc758700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:22570:1874438316625536:0@lo:900:osp-pre-1-1.0 00010000:00010000:3.0:1787604276.148744:0:21908:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787604276.148747:0:21908:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d216add0/0x6c241a9cc41dd6fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.148753:0:21908:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a083e4bc00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:3.0:1787604276.148756:0:21908:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d216add0/0x6c241a9cc41dd6fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.148764:0:21908:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d216add0/0x6c241a9cc41dd6fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604276.148768:0:22570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787604276.148775:0:21908:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d216add0/0x6c241a9cc41dd6fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.148782:0:21908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d216add0/0x6c241a9cc41dd6fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604276.148789:0:22570:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0904cd780 going to sleep for 11 seconds 00010000:00010000:3.0:1787604276.148792:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604276.148793:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604276.148794:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604276.148813:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316625536 00000100:00100000:0.0:1787604276.148820:0:21931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316625536 00000100:00100000:0.0:1787604276.148884:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787604276.149001:0:21931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:22570:x1874438316625536:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1787604276.149091:0:21931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:22570:x1874438316625536:12345-0@lo:900:osp-pre-1-1.0 Request processed in 94us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604276.149098:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787604276.149299:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1787604276.153205:0:22570:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0a0bc758700 x1874438316625536/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787604292 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604276.153223:0:22570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bc758700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:22570:1874438316625536:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1787604276.154619:0:23234:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787604276.154630:0:23234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d729ed16/0x6c241a9cc41dd702 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.154647:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1787604276.154652:0:23234:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604276.154659:0:23234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d729ed16/0x6c241a9cc41dd702 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.154672:0:23234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d729ed16/0x6c241a9cc41dd702 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.154682:0:23234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d729ed16/0x6c241a9cc41dd702 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.154721:0:23234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d729ed16/0x6c241a9cc41dd702 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604276.154739:0:23234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787604276.156970:0:22982:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787604276.156983:0:22982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d729ed16/0x6c241a9cc41dd702 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.157003:0:22982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a083e4ba00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:3.0:1787604276.157009:0:22982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d729ed16/0x6c241a9cc41dd702 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.157020:0:22982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d729ed16/0x6c241a9cc41dd702 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.157041:0:22982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d729ed16/0x6c241a9cc41dd702 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.157048:0:22982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d729ed16/0x6c241a9cc41dd702 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604276.157070:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604276.157071:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787604276.157073:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787604276.158460:0:23234:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:3.0:1787604276.158585:0:23234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:21945:x1874438316624512:12345-0@lo:5:osp-pre-0-0.0 Request processed in 180505us (180589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604276.158595:0:23234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787604276.158617:0:21945:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89353100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:21945:1874438316624512:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787604276.158633:0:21945:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:1.0:1787604276.158712:0:21945:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7793480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:21945:1874438316625664:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787604276.158752:0:21945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604276.158780:0:21945:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0832a7480 going to sleep for 11 seconds 00000100:00100000:3.0:1787604276.158917:0:24115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316625664 00000100:00100000:3.0:1787604276.158924:0:24115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316625664 00000100:00100000:3.0:1787604276.158975:0:24115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787604276.158984:0:24115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:21945:x1874438316625664:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787604276.159024:0:24115:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000004:00080000:2.0:1787604276.170959:0:6460:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1787604276.171614:0:24115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:21945:x1874438316625664:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12626us (12857us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1787604276.171625:0:24115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787604276.175937:0:21945:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7793480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:21945:1874438316625664:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787604276.175959:0:21945:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:3.0:1787604276.662740:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787604277.366070:0:8099:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:0.0:1787604277.366106:0:8099:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1787604277.686211:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604278.262047:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316625792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787604278.262118:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604278.262204:0:23236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316625792 00000100:00100000:1.0:1787604278.262212:0:23236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316625792 00000100:00100000:1.0:1787604278.262268:0:23236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787604278.262278:0:23236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090b7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316625792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787604278.262940:0:23236:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787604278.263001:0:23236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090b7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316625792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 724us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604278.263019:0:23236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787604278.263095:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787604278.263139:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316625792:0@lo:13:osp-pre-0-1.0 00000001:00080000:1.0:1787604278.424627:0:9030:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1787604278.424676:0:9030:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:1.0:1787604278.424702:0:9030:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000001:00100000:1.0:1787604278.424710:0:9030:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1787604278.715405:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604278.774244:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316625920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787604278.774309:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604278.774386:0:22565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316625920 00000100:00100000:2.0:1787604278.774393:0:22565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316625920 00000100:00100000:2.0:1787604278.774439:0:22565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787604278.774448:0:22565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316625920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787604278.774497:0:22565:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787604278.774543:0:22565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316625920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604278.774551:0:22565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787604278.774595:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316625920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787604278.774709:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787604278.774719:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3450:1874438316626048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787604278.774747:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604278.774780:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316626048 00000100:00100000:1.0:1787604278.774784:0:21925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316626048 00000100:00100000:1.0:1787604278.774824:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787604278.774831:0:21925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3450:x1874438316626048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787604278.774853:0:21925:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787604278.774889:0:21925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3450:x1874438316626048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604278.774895:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787604278.774926:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3450:1874438316626048:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787604279.733973:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787604279.913909:0:24318:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787604280.757980:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604281.340102:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316626304:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787604281.340179:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604281.340247:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787604281.340255:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a090b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3453:1874438316626176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787604281.340277:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604281.340343:0:23238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316626304 00000100:00100000:2.0:1787604281.340350:0:23238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316626304 00000100:00100000:2.0:1787604281.340395:0:23238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316626176 00000100:00100000:2.0:1787604281.340399:0:23238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316626176 00000100:00100000:2.0:1787604281.340416:0:23238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787604281.340424:0:23238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316626304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787604281.340468:0:23238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787604281.340514:0:23238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316626304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604281.340520:0:23238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787604281.340535:0:23238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787604281.340541:0:23238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3453:x1874438316626176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787604281.340558:0:23238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787604281.340581:0:23238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3453:x1874438316626176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604281.340587:0:23238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787604281.340624:0:3453:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1787604281.340645:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a090b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3453:1874438316626176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787604281.340655:0:3453:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1787604281.340670:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316626304:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787604281.344134:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787604281.344144:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787604281.346382:0:3451:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787604281.346404:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89351c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316626432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787604281.346481:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604281.346607:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3452:1874438316626688:0@lo:400:kworker.0 00000100:00100000:2.0:1787604281.346647:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604281.346673:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3452:1874438316627200:0@lo:400:kworker.0 00000100:00100000:2.0:1787604281.346715:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604281.346731:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0f28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3452:1874438316627712:0@lo:400:kworker.0 00000100:00100000:2.0:1787604281.346747:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604281.346763:0:3452:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787604281.346768:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3452:1874438316626816:0@lo:400:kworker.0 00000100:00100000:2.0:1787604281.346786:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604281.346799:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3452:1874438316627328:0@lo:400:kworker.0 00000100:00100000:2.0:1787604281.346815:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604281.346846:0:21926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316626688 00000100:00100000:2.0:1787604281.346852:0:21926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316626688 00000100:00100000:2.0:1787604281.346893:0:21926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787604281.346909:0:21926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3452:x1874438316626688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604281.346962:0:21926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3452:x1874438316626688:12345-0@lo:400:kworker.0 Request processed in 60us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604281.346969:0:21926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787604281.346994:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3451:1874438316626560:0@lo:400:kworker.0 00000100:00100000:2.0:1787604281.347022:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604281.347045:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316627072:0@lo:400:kworker.0 00000100:00100000:2.0:1787604281.347067:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604281.347084:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3451:1874438316627584:0@lo:400:kworker.0 00000100:00100000:2.0:1787604281.347107:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604281.347117:0:3451:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787604281.347122:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0f2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316626944:0@lo:400:kworker.0 00000100:00100000:2.0:1787604281.347151:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604281.347168:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3451:1874438316627456:0@lo:400:kworker.0 00000100:00100000:2.0:1787604281.347186:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604281.347205:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316626560 00000100:00100000:2.0:1787604281.347209:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316626560 00000100:00100000:2.0:1787604281.347236:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787604281.347242:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:3451:x1874438316626560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604281.347275:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89736850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:3451:x1874438316626560:12345-0@lo:400:kworker.0 Request processed in 33us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604281.347280:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787604281.347323:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3452:1874438316626688:0@lo:400:kworker.0 00000100:00100000:2.0:1787604281.347345:0:23238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316626432 00000100:00100000:2.0:1787604281.347349:0:23238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316626432 00000100:00100000:2.0:1787604281.347379:0:23238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787604281.347385:0:23238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3451:x1874438316626432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787604281.347399:0:23238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787604281.347430:0:23238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3451:x1874438316626432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604281.347436:0:23238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1787604281.347451:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787604281.347481:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3451:1874438316626560:0@lo:400:kworker.0 00000100:00100000:2.0:1787604281.347491:0:3451:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1787604281.347506:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89351c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316626432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787604281.349441:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316627200 00000100:00100000:3.0:1787604281.349466:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316627200 00000100:00100000:3.0:1787604281.349517:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316627712 00000100:00100000:3.0:1787604281.349521:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316627712 00000100:00100000:3.0:1787604281.349549:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316626816 00000100:00100000:3.0:1787604281.349552:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316626816 00000100:00100000:3.0:1787604281.349562:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316627328 00000100:00100000:3.0:1787604281.349565:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316627328 00000100:00100000:3.0:1787604281.349659:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316627584 00000100:00100000:3.0:1787604281.349663:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316627584 00000100:00100000:3.0:1787604281.349679:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316627456 00000100:00100000:3.0:1787604281.349682:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316627456 00000100:00100000:3.0:1787604281.349732:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787604281.349742:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3452:x1874438316627200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604281.349957:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3452:x1874438316627200:12345-0@lo:400:kworker.0 Request processed in 215us (3239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604281.349964:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787604281.349983:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787604281.349990:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3452:x1874438316627712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604281.350019:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3452:x1874438316627712:12345-0@lo:400:kworker.0 Request processed in 31us (3271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604281.350125:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787604281.350140:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787604281.350160:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3452:x1874438316626816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604281.350326:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3452:x1874438316626816:12345-0@lo:400:kworker.0 Request processed in 166us (3538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604281.350332:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787604281.350345:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787604281.350352:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3452:x1874438316627328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604281.350378:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3452:x1874438316627328:12345-0@lo:400:kworker.0 Request processed in 27us (3562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604281.350384:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787604281.350395:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787604281.350401:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3451:x1874438316627584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604281.350433:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3451:x1874438316627584:12345-0@lo:400:kworker.0 Request processed in 33us (3325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604281.350439:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787604281.350450:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787604281.350467:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3451:x1874438316627456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604281.350493:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3451:x1874438316627456:12345-0@lo:400:kworker.0 Request processed in 36us (3306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604281.350499:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1787604281.350542:0:3452:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa09f89350380 x1874438316626816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604281.350556:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3452:1874438316626816:0@lo:400:kworker.0 00010000:00080000:3.0:1787604281.350568:0:3452:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0a0c0f2b480 x1874438316627328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787604281.350860:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787604281.350865:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787604281.351236:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316626944 00000100:00100000:1.0:1787604281.351243:0:21925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316626944 00000100:00100000:1.0:1787604281.351291:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787604281.351299:0:21925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0f2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316626944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604281.351353:0:21925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0f2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316626944:12345-0@lo:400:kworker.0 Request processed in 55us (4200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604281.351366:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787604281.352123:0:23233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316627072 00000100:00100000:0.0:1787604281.352129:0:23233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316627072 00000100:00100000:0.0:1787604281.352172:0:23233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787604281.352179:0:23233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0f28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316627072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604281.352224:0:23233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0f28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316627072:12345-0@lo:400:kworker.0 Request processed in 46us (5156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604281.352230:0:23233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787604281.353271:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0f2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316626944:0@lo:400:kworker.0 00010000:00080000:0.0:1787604281.353289:0:3451:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0a0c0f28000 x1874438316627456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604281.353299:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3451:1874438316627456:0@lo:400:kworker.0 00000100:00100000:0.0:1787604281.353310:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316627072:0@lo:400:kworker.0 00010000:00080000:0.0:1787604281.353326:0:3451:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0a0c0f2ad80 x1874438316627584/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604281.353334:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3451:1874438316627584:0@lo:400:kworker.0 00000100:00080000:2.0:1787604281.353917:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787604281.354102:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3452:1874438316627328:0@lo:400:kworker.0 00010000:00080000:3.0:1787604281.354131:0:3452:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0a0c0f29880 x1874438316627200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604281.354142:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3452:1874438316627200:0@lo:400:kworker.0 00010000:00080000:3.0:1787604281.354158:0:3452:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0a0c0f28700 x1874438316627712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604281.354167:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0f28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3452:1874438316627712:0@lo:400:kworker.0 00010000:00010000:2.0:1787604281.782252:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604282.072470:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604282.072592:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299732864 00000100:00100000:2.0:1787604282.072602:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299732864 00000100:00100000:2.0:1787604282.072653:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 116 00000100:00100000:2.0:1787604282.072662:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2389:x1874438299732864:12345-192.168.203.16@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787604282.072729:0:21915:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c318a211-db33-4ebc-b734-b960fe78e3bb@192.168.203.16@tcp t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:2.0:1787604282.072876:0:21915:0:(genops.c:1385:class_connect()) connect: client c318a211-db33-4ebc-b734-b960fe78e3bb, cookie 0x6c241a9cc41dd709 00000100:00080000:2.0:1787604282.073026:0:21915:0:(import.c:65:import_set_state_nolock()) ffffa09f84046800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787604282.073180:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c318a211-db33-4ebc-b734-b960fe78e3bb+5:2389:x1874438299732864:12345-192.168.203.16@tcp:250:mount.lustre.0 Request processed in 517us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604282.073189:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 116 00000100:00100000:2.0:1787604282.081842:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604282.082017:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299732992 00000100:00100000:1.0:1787604282.082029:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299732992 00000100:00100000:1.0:1787604282.082085:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 117 00000100:00100000:1.0:1787604282.082096:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c318a211-db33-4ebc-b734-b960fe78e3bb+5:18364:x1874438299732992:12345-192.168.203.16@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787604282.082112:0:21914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604282.082129:0:21914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a0813d3c00/0x6c241a9cc41dd710 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb081 expref: -99 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604282.082157:0:21914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a0813d3c00/0x6c241a9cc41dd710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb081 expref: 6 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604282.082168:0:21914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a0813d3c00/0x6c241a9cc41dd710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb081 expref: 6 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604282.082180:0:21914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a0813d3c00, rc 0) 00000100:00100000:1.0:1787604282.084183:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89734850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c318a211-db33-4ebc-b734-b960fe78e3bb+6:18364:x1874438299732992:12345-192.168.203.16@tcp:101:mount.lustre.0 Request processed in 193us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604282.084196:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 117 00000100:00100000:1.0:1787604282.091355:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604282.092822:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299733120 00000100:00100000:3.0:1787604282.092836:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299733120 00000100:00100000:3.0:1787604282.092906:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 118 00000100:00100000:3.0:1787604282.092917:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c318a211-db33-4ebc-b734-b960fe78e3bb+6:18364:x1874438299733120:12345-192.168.203.16@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787604282.093481:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c318a211-db33-4ebc-b734-b960fe78e3bb+6:18364:x1874438299733120:12345-192.168.203.16@tcp:501:mount.lustre.0 Request processed in 563us (2134us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787604282.093490:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 118 00000040:00080000:2.0:1787604282.104002:0:21956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787604282.105207:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604282.105370:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299733248 00000100:00100000:2.0:1787604282.105380:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299733248 00000100:00100000:2.0:1787604282.105434:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 119 00000100:00100000:2.0:1787604282.105444:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c318a211-db33-4ebc-b734-b960fe78e3bb+6:18364:x1874438299733248:12345-192.168.203.16@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787604282.105469:0:21915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604282.105488:0:21915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a083e4b000/0x6c241a9cc41dd717 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb088 expref: -99 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604282.105517:0:21915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a083e4b000/0x6c241a9cc41dd717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb088 expref: 7 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604282.105529:0:21915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a083e4b000/0x6c241a9cc41dd717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb088 expref: 7 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604282.105557:0:21915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a083e4b000, rc 0) 00000100:00100000:2.0:1787604282.105845:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89737850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c318a211-db33-4ebc-b734-b960fe78e3bb+7:18364:x1874438299733248:12345-192.168.203.16@tcp:101:mount.lustre.0 Request processed in 402us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604282.105853:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 119 00000100:00100000:0.0:1787604282.109402:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604282.113047:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299733376 00000100:00100000:3.0:1787604282.113065:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299733376 00000100:00100000:3.0:1787604282.113142:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 120 00000100:00100000:3.0:1787604282.113153:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c318a211-db33-4ebc-b734-b960fe78e3bb+7:18364:x1874438299733376:12345-192.168.203.16@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787604282.113538:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c318a211-db33-4ebc-b734-b960fe78e3bb+8:18364:x1874438299733376:12345-192.168.203.16@tcp:501:mount.lustre.0 Request processed in 385us (4144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604282.113547:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 120 00000100:00100000:3.0:1787604282.115561:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604282.118487:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299733504 00000100:00100000:1.0:1787604282.118503:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299733504 00000100:00100000:1.0:1787604282.118585:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 121 00000100:00100000:1.0:1787604282.118606:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c318a211-db33-4ebc-b734-b960fe78e3bb+8:18364:x1874438299733504:12345-192.168.203.16@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787604282.119014:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89736050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c318a211-db33-4ebc-b734-b960fe78e3bb+8:18364:x1874438299733504:12345-192.168.203.16@tcp:503:mount.lustre.0 Request processed in 418us (3460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604282.119030:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 121 00000100:00100000:1.0:1787604282.126374:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604282.126432:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299733632 00000100:00100000:2.0:1787604282.126443:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299733632 00000100:00100000:2.0:1787604282.126574:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 122 00000100:00100000:2.0:1787604282.126585:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f84115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c318a211-db33-4ebc-b734-b960fe78e3bb+8:18383:x1874438299733632:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787604282.127884:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f84115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c318a211-db33-4ebc-b734-b960fe78e3bb+8:18383:x1874438299733632:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 1295us (1514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604282.127894:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 122 00000100:00100000:0.0:1787604282.160373:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604282.160514:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299733760 00000100:00100000:3.0:1787604282.160537:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299733760 00000100:00100000:3.0:1787604282.160608:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 123 00000100:00100000:3.0:1787604282.160619:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f84116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c318a211-db33-4ebc-b734-b960fe78e3bb+8:18383:x1874438299733760:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787604282.160920:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f84116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c318a211-db33-4ebc-b734-b960fe78e3bb+8:18383:x1874438299733760:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 302us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604282.160928:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 123 00000100:00100000:2.0:1787604282.169847:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604282.170153:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299733888 00000100:00100000:1.0:1787604282.170162:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299733888 00000100:00100000:1.0:1787604282.170219:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 124 00000100:00100000:1.0:1787604282.170228:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f84114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c318a211-db33-4ebc-b734-b960fe78e3bb+8:18383:x1874438299733888:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787604282.170531:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f84114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c318a211-db33-4ebc-b734-b960fe78e3bb+8:18383:x1874438299733888:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 303us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604282.170540:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 124 00000100:00100000:1.0:1787604282.182465:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604282.187250:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299734016 00000100:00100000:3.0:1787604282.187264:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299734016 00000100:00100000:3.0:1787604282.187345:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 125 00000100:00100000:3.0:1787604282.187356:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f84115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c318a211-db33-4ebc-b734-b960fe78e3bb+8:18364:x1874438299734016:12345-192.168.203.16@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787604282.187372:0:21913:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604282.187390:0:21913:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a080030200/0x6c241a9cc41dd71e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb0b9 expref: -99 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604282.187417:0:21913:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a080030200/0x6c241a9cc41dd71e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb0b9 expref: 9 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604282.187427:0:21913:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a080030200/0x6c241a9cc41dd71e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb0b9 expref: 9 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604282.187436:0:21913:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a080030200, rc 0) 00000100:00100000:3.0:1787604282.187519:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f84115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c318a211-db33-4ebc-b734-b960fe78e3bb+9:18364:x1874438299734016:12345-192.168.203.16@tcp:101:mount.lustre.0 Request processed in 164us (5075us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604282.187526:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 125 00000100:00100000:0.0:1787604282.190798:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604282.193190:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299734144 00000100:00100000:2.0:1787604282.193206:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299734144 00000100:00100000:2.0:1787604282.193285:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 126 00000100:00100000:2.0:1787604282.193297:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f84114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c318a211-db33-4ebc-b734-b960fe78e3bb+9:18364:x1874438299734144:12345-192.168.203.16@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787604282.193322:0:21914:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787604282.193347:0:21914:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787604282.193350:0:21914:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787604282.193354:0:21914:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787604282.193357:0:21914:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787604282.193359:0:21914:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1787604282.199131:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f84114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c318a211-db33-4ebc-b734-b960fe78e3bb+9:18364:x1874438299734144:12345-192.168.203.16@tcp:256:mount.lustre.0 Request processed in 5817us (8330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604282.199150:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 126 00000100:00100000:1.0:1787604282.202246:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604282.202510:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299734272 00000100:00100000:2.0:1787604282.202524:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299734272 00000100:00100000:2.0:1787604282.202677:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 127 00000100:00100000:2.0:1787604282.202720:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f84116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c318a211-db33-4ebc-b734-b960fe78e3bb+9:18364:x1874438299734272:12345-192.168.203.16@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787604282.202782:0:21915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604282.202805:0:21915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a083e4b800/0x6c241a9cc41dd725 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb0c0 expref: -99 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604282.202842:0:21915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a083e4b800/0x6c241a9cc41dd725 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb0c0 expref: 10 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604282.202854:0:21915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a083e4b800/0x6c241a9cc41dd725 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb0c0 expref: 10 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604282.202864:0:21915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a083e4b800, rc 0) 00000100:00100000:2.0:1787604282.202947:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f84116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c318a211-db33-4ebc-b734-b960fe78e3bb+10:18364:x1874438299734272:12345-192.168.203.16@tcp:101:mount.lustre.0 Request processed in 259us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604282.202955:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 127 00000100:00100000:0.0:1787604282.205057:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604282.205231:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299734400 00000100:00100000:2.0:1787604282.205243:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299734400 00000100:00100000:3.0:1787604282.205477:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 128 00000100:00100000:3.0:1787604282.205492:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bced3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c318a211-db33-4ebc-b734-b960fe78e3bb+10:18364:x1874438299734400:12345-192.168.203.16@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787604282.205896:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bced3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c318a211-db33-4ebc-b734-b960fe78e3bb+10:18364:x1874438299734400:12345-192.168.203.16@tcp:501:mount.lustre.0 Request processed in 408us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604282.205912:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 128 00000100:00100000:2.0:1787604282.208168:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604282.208356:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299734528 00000100:00100000:3.0:1787604282.208369:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299734528 00000100:00100000:3.0:1787604282.208427:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 129 00000100:00100000:3.0:1787604282.208438:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bced3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c318a211-db33-4ebc-b734-b960fe78e3bb+10:18364:x1874438299734528:12345-192.168.203.16@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787604282.209038:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bced3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c318a211-db33-4ebc-b734-b960fe78e3bb+10:18364:x1874438299734528:12345-192.168.203.16@tcp:503:mount.lustre.0 Request processed in 597us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604282.209048:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 129 00000100:00100000:0.0:1787604282.213626:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604282.213793:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299734656 00000100:00100000:2.0:1787604282.213806:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299734656 00000100:00100000:2.0:1787604282.213869:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 130 00000100:00100000:2.0:1787604282.213881:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c318a211-db33-4ebc-b734-b960fe78e3bb+10:18389:x1874438299734656:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787604282.214282:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c318a211-db33-4ebc-b734-b960fe78e3bb+10:18389:x1874438299734656:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 395us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604282.214292:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 130 00000100:00100000:0.0:1787604282.220493:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604282.224535:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299734784 00000100:00100000:1.0:1787604282.224561:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299734784 00000100:00100000:1.0:1787604282.224660:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 131 00000100:00100000:1.0:1787604282.224674:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c318a211-db33-4ebc-b734-b960fe78e3bb+10:18389:x1874438299734784:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787604282.225039:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c318a211-db33-4ebc-b734-b960fe78e3bb+10:18389:x1874438299734784:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 366us (4559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604282.225049:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 131 00000100:00100000:1.0:1787604282.230070:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604282.230121:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604282.231593:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299734912 00000100:00100000:2.0:1787604282.231612:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299734912 00000100:00100000:2.0:1787604282.231677:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299735168 00000100:00100000:2.0:1787604282.231681:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299735168 00000100:00100000:2.0:1787604282.231742:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:2.0:1787604282.231754:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2389:x1874438299734912:12345-192.168.203.16@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787604282.231796:0:21922:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from ee4faca9-8d42-4529-92e3-bb37c4189833@192.168.203.16@tcp t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:2.0:1787604282.231867:0:21922:0:(genops.c:1385:class_connect()) connect: client ee4faca9-8d42-4529-92e3-bb37c4189833, cookie 0x6c241a9cc41dd72c 00000004:00100000:2.0:1787604282.231910:0:21922:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787604282.232387:0:21922:0:(import.c:65:import_set_state_nolock()) ffffa09f84043800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787604282.232490:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+6:2389:x1874438299734912:12345-192.168.203.16@tcp:38:mount.lustre.0 Request processed in 736us (2434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604282.232499:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:2.0:1787604282.232524:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 8 00000100:00100000:2.0:1787604282.232529:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2389:x1874438299735168:12345-192.168.203.16@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787604282.232548:0:21922:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from ee4faca9-8d42-4529-92e3-bb37c4189833@192.168.203.16@tcp t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:2.0:1787604282.232583:0:21922:0:(genops.c:1385:class_connect()) connect: client ee4faca9-8d42-4529-92e3-bb37c4189833, cookie 0x6c241a9cc41dd733 00000004:00100000:2.0:1787604282.232601:0:21922:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787604282.232894:0:21922:0:(import.c:65:import_set_state_nolock()) ffffa09f84041800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787604282.232927:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+6:2389:x1874438299735168:12345-192.168.203.16@tcp:38:mount.lustre.0 Request processed in 394us (2804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604282.232934:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 8 00000100:00100000:0.0:1787604282.247327:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604282.247372:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604282.247407:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604282.247444:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299735424 00000100:00100000:0.0:1787604282.247466:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299735424 00000100:00100000:0.0:1787604282.247533:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299735296 00000100:00100000:0.0:1787604282.247537:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299735296 00000100:00100000:0.0:1787604282.247553:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299735040 00000100:00100000:0.0:1787604282.247556:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299735040 00000100:00100000:0.0:1787604282.247572:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 9 00000100:00100000:0.0:1787604282.247584:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc75aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+7:18364:x1874438299735424:12345-192.168.203.16@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787604282.247641:0:21920:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787604282.247781:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc75aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+7:18364:x1874438299735424:12345-192.168.203.16@tcp:41:mount.lustre.0 Request processed in 197us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604282.247789:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 9 00000100:00100000:0.0:1787604282.247812:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 10 00000100:00100000:0.0:1787604282.247820:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc75b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+6:0:x1874438299735296:12345-192.168.203.16@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787604282.247843:0:21920:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787604282.247885:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc75b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+6:0:x1874438299735296:12345-192.168.203.16@tcp:41:mount.lustre.0 Request processed in 66us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604282.247892:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 10 00000100:00100000:0.0:1787604282.247907:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 11 00000100:00100000:0.0:1787604282.247914:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+6:0:x1874438299735040:12345-192.168.203.16@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787604282.247925:0:21920:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787604282.247964:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+6:0:x1874438299735040:12345-192.168.203.16@tcp:41:mount.lustre.0 Request processed in 50us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604282.247971:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 11 00000100:00080000:2.0:1787604282.251132:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787604282.251146:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787604282.252526:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604282.254014:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299735552 00000100:00100000:3.0:1787604282.254032:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299735552 00000100:00100000:2.0:1787604282.254372:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 12 00000100:00100000:2.0:1787604282.254388:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a084f13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+6:18364:x1874438299735552:12345-192.168.203.16@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787604282.254536:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a084f13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+6:18364:x1874438299735552:12345-192.168.203.16@tcp:40:mount.lustre.0 Request processed in 151us (2020us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604282.254545:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 12 00000100:00100000:0.0:1787604282.261242:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604282.261422:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299735936 00000100:00100000:2.0:1787604282.261436:0:21931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299735936 00000100:00100000:2.0:1787604282.261517:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 3 00000100:00100000:2.0:1787604282.261529:0:21931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a084f13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ee4faca9-8d42-4529-92e3-bb37c4189833+6:18364:x1874438299735936:12345-192.168.203.16@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787604282.261647:0:21931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a084f13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ee4faca9-8d42-4529-92e3-bb37c4189833+6:18364:x1874438299735936:12345-192.168.203.16@tcp:900:mount.lustre.0 Request processed in 118us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604282.261655:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 3 00000100:00100000:1.0:1787604282.264352:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604282.264394:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604282.264470:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604282.264575:0:23234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299735680 00000100:00100000:3.0:1787604282.264588:0:23234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299735680 00000100:00100000:3.0:1787604282.264640:0:23234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299735808 00000100:00100000:3.0:1787604282.264644:0:23234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299735808 00000100:00100000:3.0:1787604282.264663:0:23234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 16 00000100:00100000:3.0:1787604282.264672:0:23234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2389:x1874438299735680:12345-192.168.203.16@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787604282.264746:0:23234:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ee4faca9-8d42-4529-92e3-bb37c4189833@192.168.203.16@tcp t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:3.0:1787604282.264791:0:23234:0:(genops.c:1385:class_connect()) connect: client ee4faca9-8d42-4529-92e3-bb37c4189833, cookie 0x6c241a9cc41dd73a 00002000:00100000:3.0:1787604282.264808:0:23234:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ee4faca9-8d42-4529-92e3-bb37c4189833/ffffa0a0c1bd9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787604282.264822:0:23234:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787604282.265240:0:23234:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787604282.265279:0:23234:0:(import.c:65:import_set_state_nolock()) ffffa0a0c1bd8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787604282.265363:0:23234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+6:2389:x1874438299735680:12345-192.168.203.16@tcp:8:mount.lustre.0 Request processed in 688us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604282.265371:0:23234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 16 00000100:00100000:3.0:1787604282.265415:0:23234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 17 00000100:00100000:3.0:1787604282.265422:0:23234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2389:x1874438299735808:12345-192.168.203.16@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787604282.265444:0:23234:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ee4faca9-8d42-4529-92e3-bb37c4189833@192.168.203.16@tcp t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:3.0:1787604282.265476:0:23234:0:(genops.c:1385:class_connect()) connect: client ee4faca9-8d42-4529-92e3-bb37c4189833, cookie 0x6c241a9cc41dd741 00002000:00100000:3.0:1787604282.265483:0:23234:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ee4faca9-8d42-4529-92e3-bb37c4189833/ffffa09f88836000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787604282.265490:0:23234:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787604282.265761:0:23234:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787604282.265779:0:23234:0:(import.c:65:import_set_state_nolock()) ffffa09f88348000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787604282.265806:0:23234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+6:2389:x1874438299735808:12345-192.168.203.16@tcp:8:mount.lustre.0 Request processed in 383us (1411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604282.265813:0:23234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 17 00000100:00100000:2.0:1787604282.266607:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299736064 00000100:00100000:2.0:1787604282.266619:0:21923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299736064 00000100:00100000:2.0:1787604282.266677:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:2.0:1787604282.266726:0:21923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+6:18364:x1874438299736064:12345-192.168.203.16@tcp:33:mount.lustre.0 00000004:00080000:3.0:1787604282.270631:0:21923:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3818us 00000004:00200000:3.0:1787604282.283782:0:21923:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787604282.284013:0:21923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+6:18364:x1874438299736064:12345-192.168.203.16@tcp:33:mount.lustre.0 Request processed in 17316us (19531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604282.284033:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 0 00000001:00100000:0.0:1787604282.407050:0:8099:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ee4faca9-8d42-4529-92e3-bb37c4189833 00000100:00100000:1.0:1787604282.498235:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604282.499187:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299736192 00000100:00100000:3.0:1787604282.499208:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299736192 00000100:00100000:3.0:1787604282.499321:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 13 00000100:00100000:3.0:1787604282.499335:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+6:18412:x1874438299736192:12345-192.168.203.16@tcp:101:mkdir.0 00010000:00010000:3.0:1787604282.499364:0:21922:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604282.499400:0:21922:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030000/0x6c241a9cc41dd748 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb0f1 expref: -99 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604282.499502:0:21922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030a00/0x6c241a9cc41dd74f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604282.499536:0:21922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030a00/0x6c241a9cc41dd74f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604282.499553:0:21922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030a00/0x6c241a9cc41dd74f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787604282.500190:0:21922:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787604282.500197:0:21922:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 2 00000004:00010000:3.0:1787604282.500371:0:21922:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030a00/0x6c241a9cc41dd74f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604282.500412:0:21922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030000/0x6c241a9cc41dd748 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb0f1 expref: 8 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604282.500436:0:21922:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030a00/0x6c241a9cc41dd74f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb0f1 expref: 7 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604282.500456:0:21922:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0a082b24f00) 00010000:00010000:3.0:1787604282.500460:0:21922:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787604282.500464:0:21922:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a080030a00, rc 0) 00000100:00100000:3.0:1787604282.500564:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+7:18412:x1874438299736192:12345-192.168.203.16@tcp:101:mkdir.0 Request processed in 1231us (2345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604282.500574:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 13 00010000:00010000:3.0:1787604282.806134:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604283.382852:0:3452:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787604283.382880:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316627840:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787604283.382963:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604283.384260:0:23238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316627840 00000100:00100000:2.0:1787604283.384275:0:23238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316627840 00000100:00100000:2.0:1787604283.384358:0:23238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787604283.384370:0:23238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3452:x1874438316627840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787604283.384413:0:23238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787604283.384518:0:23238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3452:x1874438316627840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 150us (1554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604283.384526:0:23238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1787604283.385171:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787604283.385387:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316627840:0@lo:13:osp-pre-0-1.0 00000001:00100000:2.0:1787604283.448306:0:9030:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ee4faca9-8d42-4529-92e3-bb37c4189833 00010000:00010000:1.0:1787604283.839282:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604283.896172:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3450:1874438316627968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787604283.896272:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604283.896347:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316627968 00000100:00100000:0.0:1787604283.896359:0:21925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316627968 00000100:00100000:0.0:1787604283.896445:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787604283.896457:0:21925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0f2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3450:x1874438316627968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787604283.896511:0:21925:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787604283.896570:0:21925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0f2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3450:x1874438316627968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604283.896578:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787604283.896734:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3450:1874438316627968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787604283.896909:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787604283.896919:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316628096:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787604283.896992:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604283.897059:0:21926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316628096 00000100:00100000:1.0:1787604283.897066:0:21926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316628096 00000100:00100000:1.0:1787604283.897105:0:21926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787604283.897113:0:21926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316628096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787604283.897140:0:21926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787604283.897179:0:21926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316628096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604283.897186:0:21926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787604283.897311:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316628096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787604284.658684:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604284.658856:0:21921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299736320 00000100:00100000:0.0:1787604284.658886:0:21921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299736320 00000100:00100000:0.0:1787604284.659473:0:21921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 14 00000100:00100000:0.0:1787604284.659489:0:21921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090b79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+7:18464:x1874438299736320:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:0.0:1787604284.659531:0:21921:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787604284.659682:0:21921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090b79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+7:18464:x1874438299736320:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 195us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604284.659747:0:21921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 14 00000100:00080000:2.0:1787604284.661808:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787604284.664619:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604284.664728:0:21921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299736448 00000100:00100000:0.0:1787604284.664742:0:21921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299736448 00000100:00100000:0.0:1787604284.664835:0:21921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 15 00000100:00100000:0.0:1787604284.664848:0:21921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+6:18464:x1874438299736448:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:0.0:1787604284.665077:0:21921:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787604284.665192:0:21921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+6:18464:x1874438299736448:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 346us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604284.665200:0:21921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 15 00000100:00080000:3.0:1787604284.665609:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787604284.669548:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604284.669664:0:23238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299736576 00000100:00100000:2.0:1787604284.669678:0:23238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299736576 00000100:00100000:2.0:1787604284.669814:0:23238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 10 00000100:00100000:2.0:1787604284.669827:0:23238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ee4faca9-8d42-4529-92e3-bb37c4189833+5:18464:x1874438299736576:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:2.0:1787604284.669862:0:23238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787604284.670048:0:23238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ee4faca9-8d42-4529-92e3-bb37c4189833+5:18464:x1874438299736576:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 222us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604284.670056:0:23238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 10 00000100:00080000:3.0:1787604284.670721:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787604284.676846:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604284.679274:0:23238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299736704 00000100:00100000:2.0:1787604284.679296:0:23238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299736704 00000100:00100000:2.0:1787604284.681469:0:23238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 11 00000100:00100000:2.0:1787604284.681501:0:23238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7792a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ee4faca9-8d42-4529-92e3-bb37c4189833+5:18464:x1874438299736704:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:2.0:1787604284.681559:0:23238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787604284.681709:0:23238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7792a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ee4faca9-8d42-4529-92e3-bb37c4189833+5:18464:x1874438299736704:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 204us (4858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604284.681718:0:23238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 11 00000100:00080000:3.0:1787604284.681882:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787604284.848834:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604284.848941:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299736832 00000100:00100000:3.0:1787604284.848955:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299736832 00000100:00100000:3.0:1787604284.849030:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 132 00000100:00100000:3.0:1787604284.849043:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c318a211-db33-4ebc-b734-b960fe78e3bb+10:18495:x1874438299736832:12345-192.168.203.16@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787604284.849065:0:21913:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604284.849089:0:21913:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a080030000/0x6c241a9cc41dd756 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb0f8 expref: -99 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604284.849126:0:21913:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a080030000/0x6c241a9cc41dd756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb0f8 expref: 11 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604284.849140:0:21913:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a080030000/0x6c241a9cc41dd756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb0f8 expref: 11 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604284.849151:0:21913:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a080030000, rc 0) 00000100:00100000:3.0:1787604284.849249:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c318a211-db33-4ebc-b734-b960fe78e3bb+11:18495:x1874438299736832:12345-192.168.203.16@tcp:101:mount.lustre.0 Request processed in 209us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604284.849899:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 132 00000100:00100000:0.0:1787604284.854494:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604284.855328:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299736960 00000100:00100000:2.0:1787604284.855343:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299736960 00000100:00100000:2.0:1787604284.855421:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 133 00000100:00100000:2.0:1787604284.855444:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82187850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c318a211-db33-4ebc-b734-b960fe78e3bb+11:18495:x1874438299736960:12345-192.168.203.16@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787604284.855964:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82187850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c318a211-db33-4ebc-b734-b960fe78e3bb+11:18495:x1874438299736960:12345-192.168.203.16@tcp:501:mount.lustre.0 Request processed in 529us (1482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604284.855987:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 133 00010000:00010000:2.0:1787604284.856077:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604284.864580:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604284.864781:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299737088 00000100:00100000:3.0:1787604284.864795:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299737088 00000100:00100000:3.0:1787604284.864870:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 134 00000100:00100000:3.0:1787604284.864883:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82184c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c318a211-db33-4ebc-b734-b960fe78e3bb+11:18495:x1874438299737088:12345-192.168.203.16@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787604284.865399:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82184c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c318a211-db33-4ebc-b734-b960fe78e3bb+11:18495:x1874438299737088:12345-192.168.203.16@tcp:503:mount.lustre.0 Request processed in 515us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604284.865410:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 134 00000100:00100000:0.0:1787604284.877585:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604284.877981:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299737216 00000100:00100000:1.0:1787604284.877995:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299737216 00000100:00100000:1.0:1787604284.878074:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 135 00000100:00100000:1.0:1787604284.878087:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82185450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c318a211-db33-4ebc-b734-b960fe78e3bb+11:18503:x1874438299737216:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787604284.878822:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82185450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c318a211-db33-4ebc-b734-b960fe78e3bb+11:18503:x1874438299737216:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 733us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604284.878832:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 135 00000040:00080000:3.0:1787604284.918526:0:22580:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787604284.929216:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604284.929549:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299737344 00000100:00100000:2.0:1787604284.929562:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299737344 00000100:00100000:2.0:1787604284.929632:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 136 00000100:00100000:2.0:1787604284.929646:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82186050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c318a211-db33-4ebc-b734-b960fe78e3bb+11:18503:x1874438299737344:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787604284.930102:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82186050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c318a211-db33-4ebc-b734-b960fe78e3bb+11:18503:x1874438299737344:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 455us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604284.930112:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 136 00000100:00100000:2.0:1787604284.938017:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604284.938527:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299737472 00000100:00100000:1.0:1787604284.938542:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299737472 00000100:00100000:1.0:1787604284.938612:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 137 00000100:00100000:1.0:1787604284.938642:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82185850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c318a211-db33-4ebc-b734-b960fe78e3bb+11:18503:x1874438299737472:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787604284.939036:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82185850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c318a211-db33-4ebc-b734-b960fe78e3bb+11:18503:x1874438299737472:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 396us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604284.939054:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 137 00000100:00100000:0.0:1787604284.953897:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604284.953971:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299737600 00000100:00100000:0.0:1787604284.953984:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299737600 00000100:00100000:0.0:1787604284.954067:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 138 00000100:00100000:0.0:1787604284.954080:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82187050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c318a211-db33-4ebc-b734-b960fe78e3bb+11:18495:x1874438299737600:12345-192.168.203.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787604284.954102:0:21913:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604284.954126:0:21913:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a0bc41a200/0x6c241a9cc41dd75d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb129 expref: -99 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604284.954163:0:21913:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a0bc41a200/0x6c241a9cc41dd75d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb129 expref: 12 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604284.954176:0:21913:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a0bc41a200/0x6c241a9cc41dd75d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb129 expref: 12 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604284.954187:0:21913:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a0bc41a200, rc 0) 00000100:00100000:0.0:1787604284.954268:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82187050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c318a211-db33-4ebc-b734-b960fe78e3bb+12:18495:x1874438299737600:12345-192.168.203.16@tcp:101:mount.lustre.0 Request processed in 178us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604284.954276:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 138 00000100:00100000:0.0:1787604284.958523:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604284.958753:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299737728 00000100:00100000:2.0:1787604284.958767:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299737728 00000100:00100000:2.0:1787604284.958824:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 139 00000100:00100000:2.0:1787604284.958835:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82184850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c318a211-db33-4ebc-b734-b960fe78e3bb+12:18495:x1874438299737728:12345-192.168.203.16@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787604284.958865:0:21915:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787604284.958895:0:21915:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787604284.958899:0:21915:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787604284.958904:0:21915:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787604284.958907:0:21915:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787604284.958910:0:21915:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1787604284.963971:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82184850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c318a211-db33-4ebc-b734-b960fe78e3bb+12:18495:x1874438299737728:12345-192.168.203.16@tcp:256:mount.lustre.0 Request processed in 5119us (5442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604284.963989:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 139 00000100:00100000:1.0:1787604284.974671:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604284.974824:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299737856 00000100:00100000:0.0:1787604284.974839:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299737856 00000100:00100000:0.0:1787604284.974910:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 140 00000100:00100000:0.0:1787604284.974923:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82186850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c318a211-db33-4ebc-b734-b960fe78e3bb+12:18495:x1874438299737856:12345-192.168.203.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787604284.974946:0:21914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604284.974970:0:21914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a0bc41b600/0x6c241a9cc41dd764 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb130 expref: -99 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604284.975010:0:21914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a0bc41b600/0x6c241a9cc41dd764 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb130 expref: 13 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604284.975023:0:21914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a0bc41b600/0x6c241a9cc41dd764 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb130 expref: 13 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604284.975034:0:21914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a0bc41b600, rc 0) 00000100:00100000:0.0:1787604284.975115:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82186850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c318a211-db33-4ebc-b734-b960fe78e3bb+13:18495:x1874438299737856:12345-192.168.203.16@tcp:101:mount.lustre.0 Request processed in 193us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604284.975122:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 140 00000100:00100000:0.0:1787604284.979642:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604284.981858:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299737984 00000100:00100000:2.0:1787604284.981886:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299737984 00000100:00100000:2.0:1787604284.982175:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 141 00000100:00100000:2.0:1787604284.982188:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82187c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c318a211-db33-4ebc-b734-b960fe78e3bb+13:18495:x1874438299737984:12345-192.168.203.16@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787604284.982813:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82187c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c318a211-db33-4ebc-b734-b960fe78e3bb+13:18495:x1874438299737984:12345-192.168.203.16@tcp:501:mount.lustre.0 Request processed in 623us (3181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604284.982822:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 141 00000100:00100000:2.0:1787604284.985377:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604284.985533:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299738112 00000100:00100000:3.0:1787604284.985565:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299738112 00000100:00100000:3.0:1787604284.985632:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 142 00000100:00100000:3.0:1787604284.985644:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82187450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c318a211-db33-4ebc-b734-b960fe78e3bb+13:18495:x1874438299738112:12345-192.168.203.16@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787604284.986660:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82187450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c318a211-db33-4ebc-b734-b960fe78e3bb+13:18495:x1874438299738112:12345-192.168.203.16@tcp:503:mount.lustre.0 Request processed in 1009us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604284.986673:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 142 00000100:00100000:1.0:1787604284.994819:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604284.995789:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299738240 00000100:00100000:2.0:1787604284.995804:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299738240 00000100:00100000:2.0:1787604284.996870:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 143 00000100:00100000:2.0:1787604284.996894:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82186c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c318a211-db33-4ebc-b734-b960fe78e3bb+13:18508:x1874438299738240:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787604284.997645:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82186c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c318a211-db33-4ebc-b734-b960fe78e3bb+13:18508:x1874438299738240:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 756us (2836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604284.997656:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 143 00000100:00100000:0.0:1787604285.012370:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604285.012657:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299738368 00000100:00100000:2.0:1787604285.012670:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299738368 00000100:00100000:2.0:1787604285.012769:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 144 00000100:00100000:2.0:1787604285.012780:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f82184050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c318a211-db33-4ebc-b734-b960fe78e3bb+13:18508:x1874438299738368:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787604285.013103:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f82184050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c318a211-db33-4ebc-b734-b960fe78e3bb+13:18508:x1874438299738368:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 323us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604285.013112:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 144 00000100:00100000:2.0:1787604285.026751:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604285.026917:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604285.035967:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299738496 00000100:00100000:1.0:1787604285.035990:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299738496 00000100:00100000:1.0:1787604285.036076:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299738752 00000100:00100000:1.0:1787604285.036080:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299738752 00000100:00100000:1.0:1787604285.036107:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 16 00000100:00100000:1.0:1787604285.036119:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2389:x1874438299738496:12345-192.168.203.16@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787604285.036169:0:21922:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c953df99-c275-42e9-af8a-a6deee3192d9@192.168.203.16@tcp t0 exp 0000000000000000 cur 665 last 0 00000020:00000080:1.0:1787604285.036219:0:21922:0:(genops.c:1385:class_connect()) connect: client c953df99-c275-42e9-af8a-a6deee3192d9, cookie 0x6c241a9cc41dd76b 00000004:00100000:1.0:1787604285.036271:0:21922:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787604285.036606:0:21922:0:(import.c:65:import_set_state_nolock()) ffffa09f891ee800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787604285.036744:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c953df99-c275-42e9-af8a-a6deee3192d9+6:2389:x1874438299738496:12345-192.168.203.16@tcp:38:mount.lustre.0 Request processed in 624us (10056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604285.036754:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 16 00000100:00100000:1.0:1787604285.036780:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 17 00000100:00100000:1.0:1787604285.036786:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2389:x1874438299738752:12345-192.168.203.16@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787604285.036806:0:21922:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from c953df99-c275-42e9-af8a-a6deee3192d9@192.168.203.16@tcp t0 exp 0000000000000000 cur 665 last 0 00000020:00000080:1.0:1787604285.036836:0:21922:0:(genops.c:1385:class_connect()) connect: client c953df99-c275-42e9-af8a-a6deee3192d9, cookie 0x6c241a9cc41dd772 00000004:00100000:1.0:1787604285.036857:0:21922:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787604285.036917:0:21922:0:(import.c:65:import_set_state_nolock()) ffffa09f891ed000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787604285.036961:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c953df99-c275-42e9-af8a-a6deee3192d9+6:2389:x1874438299738752:12345-192.168.203.16@tcp:38:mount.lustre.0 Request processed in 173us (10045us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604285.036969:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 17 00000100:00100000:3.0:1787604285.052445:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604285.052583:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299739008 00000100:00100000:1.0:1787604285.052599:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299739008 00000100:00100000:1.0:1787604285.052738:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 18 00000100:00100000:1.0:1787604285.052752:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c953df99-c275-42e9-af8a-a6deee3192d9+6:18495:x1874438299739008:12345-192.168.203.16@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787604285.052813:0:21922:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787604285.052915:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c953df99-c275-42e9-af8a-a6deee3192d9+6:18495:x1874438299739008:12345-192.168.203.16@tcp:41:mount.lustre.0 Request processed in 166us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604285.052925:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 18 00000100:00080000:3.0:1787604285.053123:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787604285.056867:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604285.056912:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604285.057016:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299738624 00000100:00100000:1.0:1787604285.057029:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299738624 00000100:00100000:1.0:1787604285.057094:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299738880 00000100:00100000:1.0:1787604285.057097:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299738880 00000100:00100000:1.0:1787604285.057135:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 19 00000100:00100000:1.0:1787604285.057146:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090b79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c953df99-c275-42e9-af8a-a6deee3192d9+6:0:x1874438299738624:12345-192.168.203.16@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787604285.057200:0:21922:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787604285.057319:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090b79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c953df99-c275-42e9-af8a-a6deee3192d9+6:0:x1874438299738624:12345-192.168.203.16@tcp:41:mount.lustre.0 Request processed in 174us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604285.057328:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 19 00000100:00100000:1.0:1787604285.057347:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 20 00000100:00100000:1.0:1787604285.057354:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c953df99-c275-42e9-af8a-a6deee3192d9+6:0:x1874438299738880:12345-192.168.203.16@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787604285.057384:0:21922:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787604285.057426:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c953df99-c275-42e9-af8a-a6deee3192d9+6:0:x1874438299738880:12345-192.168.203.16@tcp:41:mount.lustre.0 Request processed in 72us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604285.057463:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 20 00000100:00080000:3.0:1787604285.057637:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787604285.063097:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604285.063574:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299739136 00000100:00100000:2.0:1787604285.063588:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299739136 00000100:00100000:2.0:1787604285.063733:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 21 00000100:00100000:2.0:1787604285.063750:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a084f11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c953df99-c275-42e9-af8a-a6deee3192d9+6:18495:x1874438299739136:12345-192.168.203.16@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787604285.063872:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a084f11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c953df99-c275-42e9-af8a-a6deee3192d9+6:18495:x1874438299739136:12345-192.168.203.16@tcp:40:mount.lustre.0 Request processed in 129us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604285.063878:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 21 00000100:00100000:3.0:1787604285.065566:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604285.065730:0:23736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299739264 00000100:00100000:1.0:1787604285.065741:0:23736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299739264 00000100:00100000:1.0:1787604285.065832:0:23736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 18 00000100:00100000:1.0:1787604285.065842:0:23736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2389:x1874438299739264:12345-192.168.203.16@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787604285.065887:0:23736:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c953df99-c275-42e9-af8a-a6deee3192d9@192.168.203.16@tcp t0 exp 0000000000000000 cur 665 last 0 00000020:00000080:1.0:1787604285.065932:0:23736:0:(genops.c:1385:class_connect()) connect: client c953df99-c275-42e9-af8a-a6deee3192d9, cookie 0x6c241a9cc41dd779 00002000:00100000:1.0:1787604285.065949:0:23736:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c953df99-c275-42e9-af8a-a6deee3192d9/ffffa09f81af7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787604285.065987:0:23736:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787604285.066415:0:23736:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787604285.066467:0:23736:0:(import.c:65:import_set_state_nolock()) ffffa09f81af5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787604285.066604:0:23736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c953df99-c275-42e9-af8a-a6deee3192d9+6:2389:x1874438299739264:12345-192.168.203.16@tcp:8:mount.lustre.0 Request processed in 760us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604285.066613:0:23736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 18 00000100:00100000:3.0:1787604285.066637:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604285.066662:0:24115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299739392 00000100:00100000:1.0:1787604285.066668:0:24115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299739392 00000100:00100000:1.0:1787604285.066718:0:24115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 19 00000100:00100000:1.0:1787604285.066724:0:24115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a090b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2389:x1874438299739392:12345-192.168.203.16@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787604285.066748:0:24115:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c953df99-c275-42e9-af8a-a6deee3192d9@192.168.203.16@tcp t0 exp 0000000000000000 cur 665 last 0 00000020:00000080:1.0:1787604285.066772:0:24115:0:(genops.c:1385:class_connect()) connect: client c953df99-c275-42e9-af8a-a6deee3192d9, cookie 0x6c241a9cc41dd780 00002000:00100000:1.0:1787604285.066780:0:24115:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c953df99-c275-42e9-af8a-a6deee3192d9/ffffa09f84131800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787604285.066789:0:24115:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1787604285.066798:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00002000:00080000:1.0:1787604285.066897:0:24115:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787604285.066915:0:24115:0:(import.c:65:import_set_state_nolock()) ffffa09f84131000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787604285.066978:0:24115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a090b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c953df99-c275-42e9-af8a-a6deee3192d9+6:2389:x1874438299739392:12345-192.168.203.16@tcp:8:mount.lustre.0 Request processed in 252us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604285.066985:0:24115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 19 00000100:00100000:2.0:1787604285.067192:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299739520 00000100:00100000:2.0:1787604285.067197:0:21931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299739520 00000100:00100000:2.0:1787604285.067289:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 4 00000100:00100000:2.0:1787604285.067298:0:21931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a009ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c953df99-c275-42e9-af8a-a6deee3192d9+6:18495:x1874438299739520:12345-192.168.203.16@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787604285.067344:0:21931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a009ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c953df99-c275-42e9-af8a-a6deee3192d9+6:18495:x1874438299739520:12345-192.168.203.16@tcp:900:mount.lustre.0 Request processed in 48us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604285.067351:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 4 00000100:00100000:3.0:1787604285.068905:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604285.069143:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299739648 00000100:00100000:0.0:1787604285.069154:0:21924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299739648 00000100:00100000:0.0:1787604285.069241:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1 00000100:00100000:0.0:1787604285.069252:0:21924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a009ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c953df99-c275-42e9-af8a-a6deee3192d9+6:18495:x1874438299739648:12345-192.168.203.16@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787604285.069664:0:21924:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787604285.069871:0:21924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a009ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c953df99-c275-42e9-af8a-a6deee3192d9+6:18495:x1874438299739648:12345-192.168.203.16@tcp:33:mount.lustre.0 Request processed in 619us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604285.069888:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1 00000100:00100000:1.0:1787604285.258412:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604285.258636:0:21921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299739776 00000100:00100000:2.0:1787604285.258651:0:21921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299739776 00000100:00100000:2.0:1787604285.258911:0:21921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 22 00000100:00100000:2.0:1787604285.258926:0:21921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c953df99-c275-42e9-af8a-a6deee3192d9+6:18531:x1874438299739776:12345-192.168.203.16@tcp:101:mkdir.0 00010000:00010000:2.0:1787604285.258955:0:21921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604285.258996:0:21921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a000/0x6c241a9cc41dd787 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb161 expref: -99 pid: 21921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604285.259097:0:21921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4ba00/0x6c241a9cc41dd78e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604285.259117:0:21921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4ba00/0x6c241a9cc41dd78e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604285.259167:0:21921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4ba00/0x6c241a9cc41dd78e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787604285.259465:0:21921:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787604285.259470:0:21921:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 2 00000004:00010000:2.0:1787604285.259571:0:21921:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4ba00/0x6c241a9cc41dd78e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604285.259607:0:21921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a000/0x6c241a9cc41dd787 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb161 expref: 8 pid: 21921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604285.259627:0:21921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4ba00/0x6c241a9cc41dd78e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb161 expref: 7 pid: 21921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604285.259636:0:21921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0a082b24f00) 00010000:00010000:2.0:1787604285.259639:0:21921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787604285.259643:0:21921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a083e4ba00, rc 0) 00000100:00100000:2.0:1787604285.259808:0:21921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c953df99-c275-42e9-af8a-a6deee3192d9+7:18531:x1874438299739776:12345-192.168.203.16@tcp:101:mkdir.0 Request processed in 884us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604285.259816:0:21921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 22 00010000:00010000:3.0:1787604285.878976:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787604286.454748:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3453:1874438316628352:0@lo:400:kworker.0 00000100:00100000:1.0:1787604286.454844:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604286.454910:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316628864:0@lo:400:kworker.0 00000100:00100000:1.0:1787604286.454934:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604286.454952:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3453:1874438316629376:0@lo:400:kworker.0 00000100:00100000:1.0:1787604286.454981:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604286.455015:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcb4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316629888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787604286.455047:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604286.455076:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1787604286.455082:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3453:1874438316628224:0@lo:400:kworker.0 00000100:00100000:1.0:1787604286.455113:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604286.455137:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3453:1874438316628736:0@lo:400:kworker.0 00000100:00100000:0.0:1787604286.455355:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316628608:0@lo:400:kworker.0 00000100:00100000:0.0:1787604286.455405:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604286.455440:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316629120:0@lo:400:kworker.0 00000100:00100000:0.0:1787604286.455464:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604286.455485:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3451:1874438316629632:0@lo:400:kworker.0 00000100:00100000:0.0:1787604286.455505:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604286.455524:0:3451:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1787604286.455530:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316628480:0@lo:400:kworker.0 00000100:00100000:0.0:1787604286.455552:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604286.455569:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316628992:0@lo:400:kworker.0 00000100:00100000:0.0:1787604286.455588:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604286.455605:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3451:1874438316629504:0@lo:400:kworker.0 00000100:00100000:0.0:1787604286.455625:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604286.455642:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a084f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316630016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787604286.455662:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604286.455716:0:23233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316628608 00000100:00100000:0.0:1787604286.455729:0:23233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316628608 00000100:00100000:0.0:1787604286.455797:0:23233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316629120 00000100:00100000:0.0:1787604286.455800:0:23233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316629120 00000100:00100000:0.0:1787604286.455816:0:23233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316628480 00000100:00100000:0.0:1787604286.455818:0:23233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316628480 00000100:00100000:0.0:1787604286.455833:0:23233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316628992 00000100:00100000:0.0:1787604286.455836:0:23233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316628992 00000100:00100000:0.0:1787604286.455852:0:23233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787604286.455862:0:23233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a084f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3451:x1874438316628608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604286.455950:0:23233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a084f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3451:x1874438316628608:12345-0@lo:400:kworker.0 Request processed in 88us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604286.455957:0:23233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787604286.455979:0:23233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787604286.455985:0:23233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c179ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316629120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604286.456013:0:23233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c179ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316629120:12345-0@lo:400:kworker.0 Request processed in 28us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604286.456020:0:23233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787604286.456034:0:23233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787604286.456040:0:23233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c179e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3451:x1874438316628480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604286.456069:0:23233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c179e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3451:x1874438316628480:12345-0@lo:400:kworker.0 Request processed in 30us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604286.456075:0:23233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787604286.456088:0:23233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787604286.456094:0:23233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c179d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316628992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604286.456121:0:23233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c179d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316628992:12345-0@lo:400:kworker.0 Request processed in 28us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604286.456127:0:23233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787604286.456502:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604286.456521:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0c04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3453:1874438316629248:0@lo:400:kworker.0 00000100:00100000:1.0:1787604286.456542:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604286.456552:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcb48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3453:1874438316629760:0@lo:400:kworker.0 00000100:00100000:1.0:1787604286.456572:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604286.456605:0:22565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316628352 00000100:00100000:1.0:1787604286.456609:0:22565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316628352 00000100:00100000:1.0:1787604286.456640:0:22565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316628864 00000100:00100000:1.0:1787604286.456642:0:22565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316628864 00000100:00100000:1.0:1787604286.456668:0:22565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787604286.456674:0:22565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1874438316628352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604286.456740:0:22565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1874438316628352:12345-0@lo:400:kworker.0 Request processed in 65us (1896us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604286.456746:0:22565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787604286.456760:0:22565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787604286.456766:0:22565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316628864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604286.456794:0:22565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316628864:12345-0@lo:400:kworker.0 Request processed in 28us (1859us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604286.456799:0:22565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787604286.456824:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316629376 00000100:00100000:1.0:1787604286.456827:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316629376 00000100:00100000:1.0:1787604286.456847:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316629632 00000100:00100000:1.0:1787604286.456849:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316629632 00000100:00100000:1.0:1787604286.456860:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316629504 00000100:00100000:1.0:1787604286.456863:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316629504 00000100:00100000:1.0:1787604286.456873:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316628736 00000100:00100000:1.0:1787604286.456875:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316628736 00000100:00100000:1.0:1787604286.456884:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316629248 00000100:00100000:1.0:1787604286.456886:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316629248 00000100:00100000:1.0:1787604286.456895:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316629760 00000100:00100000:1.0:1787604286.456896:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316629760 00000100:00100000:1.0:1787604286.456908:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787604286.456913:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3453:x1874438316629376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604286.456942:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3453:x1874438316629376:12345-0@lo:400:kworker.0 Request processed in 29us (1962us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604286.456948:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787604286.456958:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787604286.456964:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c179d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3451:x1874438316629632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604286.457000:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c179d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3451:x1874438316629632:12345-0@lo:400:kworker.0 Request processed in 36us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604286.457005:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787604286.457017:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787604286.457023:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c179c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3451:x1874438316629504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604286.457046:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c179c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3451:x1874438316629504:12345-0@lo:400:kworker.0 Request processed in 23us (1420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604286.457051:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787604286.457062:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787604286.457067:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3453:x1874438316628736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604286.457088:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3453:x1874438316628736:12345-0@lo:400:kworker.0 Request processed in 21us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604286.457093:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787604286.457102:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787604286.457107:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3453:x1874438316629248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604286.457131:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3453:x1874438316629248:12345-0@lo:400:kworker.0 Request processed in 23us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604286.457137:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787604286.457430:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316628224 00000100:00100000:2.0:1787604286.457435:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316628224 00000100:00100000:2.0:1787604286.457475:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787604286.457483:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:3453:x1874438316628224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604286.457525:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:3453:x1874438316628224:12345-0@lo:400:kworker.0 Request processed in 43us (2410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604286.457531:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787604286.457831:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787604286.457843:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3453:x1874438316629760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604286.457882:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3453:x1874438316629760:12345-0@lo:400:kworker.0 Request processed in 43us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604286.457889:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787604286.457930:0:23236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316629888 00000100:00100000:0.0:1787604286.457934:0:23236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316629888 00000100:00100000:0.0:1787604286.457963:0:23236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316630016 00000100:00100000:0.0:1787604286.457967:0:23236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316630016 00000100:00100000:0.0:1787604286.457980:0:23236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787604286.457998:0:23236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316629888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787604286.458035:0:23236:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787604286.458076:0:23236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316629888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (3028us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604286.458082:0:23236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787604286.458096:0:23236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787604286.458101:0:23236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c179fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3451:x1874438316630016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787604286.458112:0:23236:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787604286.458136:0:23236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c179fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3451:x1874438316630016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (2473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604286.458934:0:23236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1787604286.458973:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787604286.458980:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787604286.459802:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3453:1874438316628224:0@lo:400:kworker.0 00000100:00100000:1.0:1787604286.459830:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3453:1874438316628736:0@lo:400:kworker.0 00000100:00100000:1.0:1787604286.459845:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3453:1874438316629248:0@lo:400:kworker.0 00010000:00080000:1.0:1787604286.459862:0:3453:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0a0bcb48700 x1874438316629760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604286.459901:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcb48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3453:1874438316629760:0@lo:400:kworker.0 00000100:00100000:1.0:1787604286.459916:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3453:1874438316628352:0@lo:400:kworker.0 00000100:00100000:1.0:1787604286.459928:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316628864:0@lo:400:kworker.0 00000100:00100000:1.0:1787604286.459941:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3453:1874438316629376:0@lo:400:kworker.0 00000100:00100000:1.0:1787604286.459965:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcb4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316629888:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787604286.460345:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787604286.460351:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787604286.460830:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316628480:0@lo:400:kworker.0 00000100:00100000:0.0:1787604286.460848:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316628992:0@lo:400:kworker.0 00010000:00080000:0.0:1787604286.460864:0:3451:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0a0c0c05f80 x1874438316629504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604286.460874:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3451:1874438316629504:0@lo:400:kworker.0 00000100:00100000:0.0:1787604286.460895:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a084f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316630016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787604286.460905:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316628608:0@lo:400:kworker.0 00000100:00100000:0.0:1787604286.460931:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316629120:0@lo:400:kworker.0 00000100:00100000:0.0:1787604286.460944:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0c07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3451:1874438316629632:0@lo:400:kworker.0 00000100:00100000:3.0:1787604286.464411:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787604286.464468:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3450:1874438316630144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787604286.464565:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604286.470948:0:23236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316630144 00000100:00100000:1.0:1787604286.470974:0:23236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316630144 00000100:00100000:1.0:1787604286.471066:0:23236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787604286.471079:0:23236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a009e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1874438316630144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787604286.471117:0:23236:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787604286.471375:0:23236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a009e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3450:x1874438316630144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 297us (6809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604286.471385:0:23236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787604286.471468:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3450:1874438316630144:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1787604286.549609:0:7237:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c953df99-c275-42e9-af8a-a6deee3192d9 00000001:00100000:3.0:1787604286.549644:0:7237:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ee4faca9-8d42-4529-92e3-bb37c4189833 00000001:00100000:3.0:1787604286.553714:0:6460:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c953df99-c275-42e9-af8a-a6deee3192d9 00000001:00100000:3.0:1787604286.553737:0:6460:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ee4faca9-8d42-4529-92e3-bb37c4189833 00010000:00010000:2.0:1787604286.902937:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787604287.569321:0:8099:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c953df99-c275-42e9-af8a-a6deee3192d9 00010000:00010000:2.0:1787604287.925921:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787604288.388918:0:24522:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1787604288.504899:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787604288.504921:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcb4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316630272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787604288.504991:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604288.505036:0:23236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316630272 00000100:00100000:1.0:1787604288.505043:0:23236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316630272 00000100:00100000:1.0:1787604288.505103:0:23236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787604288.505113:0:23236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316630272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787604288.505147:0:23236:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787604288.505192:0:23236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316630272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604288.505208:0:23236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1787604288.506460:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787604288.521292:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcb4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316630272:0@lo:13:osp-pre-0-1.0 00000001:00100000:3.0:1787604288.564562:0:9030:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c953df99-c275-42e9-af8a-a6deee3192d9 00010000:00010000:3.0:1787604288.950600:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604289.015072:0:3452:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787604289.015113:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c0f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3452:1874438316630400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787604289.015219:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604289.015286:0:3451:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787604289.015310:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcb4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316630528:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787604289.015397:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604289.015468:0:22565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316630400 00000100:00100000:1.0:1787604289.015480:0:22565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316630400 00000100:00100000:1.0:1787604289.015552:0:22565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316630528 00000100:00100000:1.0:1787604289.015556:0:22565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316630528 00000100:00100000:1.0:1787604289.015576:0:22565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787604289.015587:0:22565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c179f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3452:x1874438316630400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787604289.015650:0:22565:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787604289.015709:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787604289.015729:0:21925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316630528:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787604289.015765:0:22565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c179f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3452:x1874438316630400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 176us (546us total) trans 0 rc 0/0 00000004:00000024:2.0:1787604289.015775:0:21925:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787604289.015788:0:22565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787604289.015845:0:21925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316630528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604289.015854:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787604289.015863:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c0f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3452:1874438316630400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787604289.015917:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcb4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316630528:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787604289.974363:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604290.282460:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604290.282499:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604290.282521:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604290.282540:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604290.282558:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604290.282577:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604290.282597:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604290.282614:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604290.282629:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604290.282657:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299739904 00000100:00100000:2.0:1787604290.282666:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299739904 00000100:00100000:2.0:1787604290.282729:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 146 00000100:00100000:2.0:1787604290.282740:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c318a211-db33-4ebc-b734-b960fe78e3bb+13:2390:x1874438299739904:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787604290.282803:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c318a211-db33-4ebc-b734-b960fe78e3bb+13:2390:x1874438299739904:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 65us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604290.282820:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 146 00000100:00100000:2.0:1787604290.282855:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299740160 00000100:00100000:2.0:1787604290.282859:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299740160 00000100:00100000:2.0:1787604290.282891:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299740672 00000100:00100000:2.0:1787604290.282894:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299740672 00000100:00100000:2.0:1787604290.282906:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299740032 00000100:00100000:2.0:1787604290.282909:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299740032 00000100:00100000:2.0:1787604290.282922:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299740544 00000100:00100000:2.0:1787604290.282933:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299740544 00000100:00100000:2.0:1787604290.282949:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 41 00000100:00100000:2.0:1787604290.282956:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0f29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+5:2390:x1874438299740160:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787604290.282987:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0f29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+5:2390:x1874438299740160:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 32us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604290.282994:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 41 00000100:00100000:2.0:1787604290.283009:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 42 00000100:00100000:2.0:1787604290.283015:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c953df99-c275-42e9-af8a-a6deee3192d9+5:2390:x1874438299740672:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787604290.283038:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c953df99-c275-42e9-af8a-a6deee3192d9+5:2390:x1874438299740672:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 24us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604290.283045:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 42 00000100:00100000:2.0:1787604290.283055:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 43 00000100:00100000:2.0:1787604290.283061:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+6:2390:x1874438299740032:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787604290.283084:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+6:2390:x1874438299740032:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 23us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604290.283089:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 43 00000100:00100000:2.0:1787604290.283102:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 44 00000100:00100000:2.0:1787604290.283117:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c953df99-c275-42e9-af8a-a6deee3192d9+6:2390:x1874438299740544:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787604290.283139:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c953df99-c275-42e9-af8a-a6deee3192d9+6:2390:x1874438299740544:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 24us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604290.283145:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 44 00000100:00100000:2.0:1787604290.283162:0:23233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299740416 00000100:00100000:2.0:1787604290.283165:0:23233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299740416 00000100:00100000:2.0:1787604290.283197:0:23233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299740928 00000100:00100000:2.0:1787604290.283200:0:23233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299740928 00000100:00100000:2.0:1787604290.283212:0:23233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299740288 00000100:00100000:2.0:1787604290.283214:0:23233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299740288 00000100:00100000:2.0:1787604290.283231:0:23233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299740800 00000100:00100000:2.0:1787604290.283234:0:23233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299740800 00000100:00100000:2.0:1787604290.283245:0:23233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:2.0:1787604290.283251:0:23233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0f28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+5:2390:x1874438299740416:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787604290.283276:0:23233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0f28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+5:2390:x1874438299740416:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 25us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604290.283283:0:23233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:2.0:1787604290.283295:0:23233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 8 00000100:00100000:2.0:1787604290.283300:0:23233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c953df99-c275-42e9-af8a-a6deee3192d9+5:2390:x1874438299740928:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787604290.283321:0:23233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c953df99-c275-42e9-af8a-a6deee3192d9+5:2390:x1874438299740928:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 21us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604290.283328:0:23233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 8 00000100:00100000:2.0:1787604290.283338:0:23233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 9 00000100:00100000:2.0:1787604290.283344:0:23233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89351c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+5:2390:x1874438299740288:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787604290.283362:0:23233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89351c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+5:2390:x1874438299740288:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 19us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604290.283373:0:23233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 9 00000100:00100000:2.0:1787604290.283385:0:23233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 10 00000100:00100000:2.0:1787604290.283390:0:23233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c953df99-c275-42e9-af8a-a6deee3192d9+5:2390:x1874438299740800:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787604290.283419:0:23233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c953df99-c275-42e9-af8a-a6deee3192d9+5:2390:x1874438299740800:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 29us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604290.283424:0:23233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 10 00000100:00080000:2.0:1787604290.283564:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787604290.283568:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787604290.283570:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787604290.283572:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787604290.999836:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604291.574873:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcf95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316630656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787604291.574973:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604291.575064:0:23236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316630656 00000100:00100000:2.0:1787604291.575074:0:23236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316630656 00000100:00100000:2.0:1787604291.575139:0:23236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787604291.575148:0:23236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3451:x1874438316630656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787604291.575191:0:23236:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787604291.575247:0:23236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3451:x1874438316630656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604291.575255:0:23236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1787604291.575279:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787604291.575320:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcf95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316630656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787604291.578433:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3452:1874438316630784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787604291.579051:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c179c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316630912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787604291.579200:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604291.579298:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604291.579415:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3450:1874438316631040:0@lo:400:kworker.0 00000100:00100000:1.0:1787604291.579469:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604291.579490:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b6f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3452:1874438316631296:0@lo:400:kworker.0 00000100:00100000:1.0:1787604291.579509:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b6f6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316631552:0@lo:400:kworker.0 00000100:00100000:3.0:1787604291.585561:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316631168:0@lo:400:kworker.0 00000100:00100000:3.0:1787604291.585669:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604291.585743:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b6f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316631680:0@lo:400:kworker.0 00000100:00100000:3.0:1787604291.585773:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604291.585795:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b6f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3451:1874438316632192:0@lo:400:kworker.0 00000100:00100000:3.0:1787604291.585823:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604291.585872:0:22565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316631168 00000100:00100000:3.0:1787604291.585881:0:22565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316631168 00000100:00100000:3.0:1787604291.585937:0:22565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787604291.585947:0:22565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b6f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3451:x1874438316631168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604291.586030:0:22565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b6f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3451:x1874438316631168:12345-0@lo:400:kworker.0 Request processed in 83us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604291.586039:0:22565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787604291.586067:0:23233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316631680 00000100:00100000:3.0:1787604291.586071:0:23233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316631680 00000100:00100000:3.0:1787604291.586115:0:23233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787604291.586122:0:23233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b6f6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316631680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604291.586562:0:23233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b6f6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316631680:12345-0@lo:400:kworker.0 Request processed in 439us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604291.586571:0:23233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787604291.586601:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316632192 00000100:00100000:3.0:1787604291.586606:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316632192 00000100:00100000:3.0:1787604291.586644:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787604291.586651:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b6f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3451:x1874438316632192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604291.586714:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b6f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3451:x1874438316632192:12345-0@lo:400:kworker.0 Request processed in 37us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604291.586744:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1787604291.586774:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787604291.586781:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787604291.586819:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316631168:0@lo:400:kworker.0 00000100:00100000:3.0:1787604291.586832:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b6f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316631680:0@lo:400:kworker.0 00000100:00100000:3.0:1787604291.586842:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b6f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3451:1874438316632192:0@lo:400:kworker.0 00000100:00100000:2.0:1787604291.587013:0:23236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316630784 00000100:00100000:2.0:1787604291.587026:0:23236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316630784 00000100:00100000:2.0:1787604291.587064:0:23236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316630912 00000100:00100000:2.0:1787604291.587068:0:23236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316630912 00000100:00080000:3.0:1787604291.587081:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787604291.587088:0:23236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787604291.587098:0:23236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a009d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3452:x1874438316630784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787604291.587151:0:23236:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787604291.587201:0:23236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a009d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3452:x1874438316630784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (8677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604291.587215:0:23236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787604291.587230:0:23236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787604291.587238:0:23236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c179dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316630912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787604291.587249:0:23236:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787604291.587281:0:23236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c179dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316630912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (7984us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604291.587288:0:23236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787604291.587883:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604291.587923:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b6f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3452:1874438316631808:0@lo:400:kworker.0 00000100:00100000:2.0:1787604291.587994:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604291.588030:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b6f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3452:1874438316632320:0@lo:400:kworker.0 00000100:00100000:2.0:1787604291.588055:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604291.588098:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3452:1874438316630784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787604291.588824:0:21921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316631296 00000100:00100000:3.0:1787604291.588825:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316631808 00000100:00100000:3.0:1787604291.588835:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316631808 00000100:00100000:2.0:1787604291.588836:0:21921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316631296 00000100:00100000:2.0:1787604291.588885:0:21921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316632320 00000100:00100000:2.0:1787604291.588890:0:21921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316632320 00000100:00100000:3.0:1787604291.588895:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787604291.588907:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3452:x1874438316631296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604291.588925:0:21921:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787604291.588935:0:21921:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787604291.588992:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3452:x1874438316631296:12345-0@lo:400:kworker.0 Request processed in 87us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604291.589000:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787604291.589018:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787604291.589025:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3452:x1874438316631808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604291.589058:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3452:x1874438316631808:12345-0@lo:400:kworker.0 Request processed in 32us (1063us total) trans 0 rc 0/0 00000100:00080000:2.0:1787604291.589058:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787604291.589068:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787604291.589083:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787604291.589093:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3452:x1874438316632320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604291.589124:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3452:x1874438316632320:12345-0@lo:400:kworker.0 Request processed in 35us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604291.589130:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787604291.589174:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b6f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3452:1874438316631296:0@lo:400:kworker.0 00000100:00100000:3.0:1787604291.589188:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b6f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3452:1874438316631808:0@lo:400:kworker.0 00010000:00080000:3.0:1787604291.589201:0:3452:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0a0b6f6e300 x1874438316632320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787604291.589211:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b6f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3452:1874438316632320:0@lo:400:kworker.0 00000100:00100000:3.0:1787604291.589232:0:3452:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787604291.589242:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b6f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316631424:0@lo:400:kworker.0 00000100:00100000:3.0:1787604291.589278:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604291.589308:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b6f6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3452:1874438316631936:0@lo:400:kworker.0 00000100:00100000:3.0:1787604291.589335:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604291.589362:0:21921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316631936 00000100:00100000:3.0:1787604291.589365:0:21921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316631936 00000100:00100000:3.0:1787604291.589405:0:21921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787604291.589411:0:21921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b6f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3452:x1874438316631936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604291.589468:0:21921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b6f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3452:x1874438316631936:12345-0@lo:400:kworker.0 Request processed in 56us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604291.589475:0:21921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787604291.589491:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b6f6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3452:1874438316631936:0@lo:400:kworker.0 00000100:00080000:3.0:1787604291.589495:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787604291.590358:0:21926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316631424 00000100:00100000:0.0:1787604291.590366:0:21926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316631424 00000100:00100000:0.0:1787604291.591117:0:21926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787604291.591131:0:21926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b6f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3452:x1874438316631424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604291.591296:0:21926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b6f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3452:x1874438316631424:12345-0@lo:400:kworker.0 Request processed in 168us (2016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604291.591304:0:21926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787604291.591382:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b6f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316631424:0@lo:400:kworker.0 00000100:00100000:1.0:1787604291.591980:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316631040 00000100:00100000:1.0:1787604291.591990:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316631040 00000100:00100000:1.0:1787604291.592036:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787604291.592101:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:3450:x1874438316631040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604291.592161:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:3450:x1874438316631040:12345-0@lo:400:kworker.0 Request processed in 64us (12693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604291.592184:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787604291.594967:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604291.595061:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b6f6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3450:1874438316632064:0@lo:400:kworker.0 00000100:00100000:1.0:1787604291.595116:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604291.595176:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3450:1874438316631040:0@lo:400:kworker.0 00000100:00100000:3.0:1787604291.595205:0:24644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316632064 00000100:00100000:3.0:1787604291.595224:0:24644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316632064 00000100:00100000:2.0:1787604291.595297:0:24115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316631552 00000100:00100000:2.0:1787604291.595303:0:24115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316631552 00000100:00100000:3.0:1787604291.595324:0:21921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787604291.595337:0:21921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3450:x1874438316632064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604291.595351:0:24115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787604291.595362:0:24115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316631552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787604291.595430:0:24115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316631552:12345-0@lo:400:kworker.0 Request processed in 71us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604291.595439:0:24115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787604291.595805:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c179c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316630912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787604291.596072:0:21921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3450:x1874438316632064:12345-0@lo:400:kworker.0 Request processed in 736us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604291.596081:0:21921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1787604291.596463:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787604291.596470:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787604291.596498:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b6f6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316631552:0@lo:400:kworker.0 00010000:00080000:1.0:1787604291.596515:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0a0b6f6ed80 x1874438316632064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787604291.596535:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b6f6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3450:1874438316632064:0@lo:400:kworker.0 00010000:00010000:3.0:1787604292.023981:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787604292.281751:0:24674:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff155adc70 20000000:00000080:2.0:1787604292.281821:0:24674:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa09f810c9800 uarg=0000000000000000 20000000:01000000:2.0:1787604292.281880:0:24674:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787604292.281888:0:24674:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787604292.281894:0:24674:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787604292.283828:0:24675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1787604292.285095:0:24674:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787604292.294004:0:24674:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787604292.294544:0:24674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0a0bc41a400/0x6c241a9cc41dd795 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604292.294572:0:24674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0a080031c00/0x6c241a9cc41dd3f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd3eb expref: 23 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604292.294582:0:24674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa09f89d23000/0x6c241a9cc41dd400 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd3f9 expref: 23 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604292.294590:0:24674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0a0813d3000/0x6c241a9cc41dd43f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd438 expref: 23 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604292.294636:0:24674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0a0bc44fa00/0x6c241a9cc41dd4d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd4d2 expref: 23 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604292.294648:0:24674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0a083e4b800/0x6c241a9cc41dd725 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb0c0 expref: 12 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604292.294657:0:24674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0a0bc41b600/0x6c241a9cc41dd764 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb130 expref: 12 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604292.294666:0:24674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0a0bc41a400/0x6c241a9cc41dd795 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604292.294769:0:24674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0a0bc41b600/0x6c241a9cc41dd764 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb130 expref: 12 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604292.294792:0:24674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0a0bc41b600/0x6c241a9cc41dd764 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb130 expref: 12 pid: 21914 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604292.294812:0:24674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c179c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24674:1874438316632448:192.168.203.16@tcp:104: 00010000:00010000:0.0:1787604292.294951:0:24674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0a083e4b800/0x6c241a9cc41dd725 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb0c0 expref: 12 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604292.294961:0:24674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0a083e4b800/0x6c241a9cc41dd725 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb0c0 expref: 12 pid: 21915 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604292.294971:0:24674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c179f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24674:1874438316632576:192.168.203.16@tcp:104: 00010000:00010000:0.0:1787604292.295006:0:24674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0a0bc44fa00/0x6c241a9cc41dd4d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c241a9cc41dd4d2 expref: 23 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604292.295028:0:24674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0a0bc44fa00/0x6c241a9cc41dd4d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c241a9cc41dd4d2 expref: 23 pid: 21914 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604292.295039:0:24674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c179c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24674:1874438316632704:0@lo:104: 00000100:00100000:0.0:1787604292.295091:0:24674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787604292.295152:0:24674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0a0813d3000/0x6c241a9cc41dd43f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c241a9cc41dd438 expref: 23 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604292.295161:0:24674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0a0813d3000/0x6c241a9cc41dd43f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c241a9cc41dd438 expref: 23 pid: 21914 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604292.295170:0:24674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c179ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24674:1874438316632832:0@lo:104: 00000100:00100000:0.0:1787604292.295194:0:24674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787604292.295231:0:24674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa09f89d23000/0x6c241a9cc41dd400 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c241a9cc41dd3f9 expref: 23 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604292.295240:0:24674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa09f89d23000/0x6c241a9cc41dd400 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c241a9cc41dd3f9 expref: 23 pid: 21915 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604292.295248:0:24674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c179ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24674:1874438316632960:0@lo:104: 00000100:00100000:0.0:1787604292.295268:0:24674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787604292.295287:0:24674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0a080031c00/0x6c241a9cc41dd3f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c241a9cc41dd3eb expref: 23 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604292.295295:0:24674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0a080031c00/0x6c241a9cc41dd3f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c241a9cc41dd3eb expref: 23 pid: 21915 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604292.295304:0:24674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0c179f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24674:1874438316633088:0@lo:104: 00000100:00100000:0.0:1787604292.295343:0:24674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604292.295355:0:24674:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0854759c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787604292.295485:0:21903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316632704 00000100:00100000:2.0:1787604292.295496:0:21903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316632704 00000100:00100000:2.0:1787604292.295550:0:21903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316632832 00000100:00100000:2.0:1787604292.295554:0:21903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316632832 00000100:00100000:2.0:1787604292.295566:0:21903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316632960 00000100:00100000:2.0:1787604292.295569:0:21903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316632960 00000100:00100000:2.0:1787604292.295579:0:21903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316633088 00000100:00100000:2.0:1787604292.295582:0:21903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316633088 00000100:00100000:2.0:1787604292.295596:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787604292.295608:0:21903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c179d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+6:24674:x1874438316632704:12345-0@lo:104: 00010000:00010000:2.0:1787604292.295624:0:21903:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e000/0x6c241a9cc41dd4d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c241a9cc41dd4d9 expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.295735:0:21903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787604292.295743:0:21903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c179d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+6:24674:x1874438316632704:12345-0@lo:104: Request processed in 136us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604292.295751:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787604292.295773:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787604292.295780:0:21903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c179df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+5:24674:x1874438316632832:12345-0@lo:104: 00010000:00010000:2.0:1787604292.295788:0:21903:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd438 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c241a9cc41dd43f expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.295824:0:21903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787604292.295830:0:21903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c179df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+5:24674:x1874438316632832:12345-0@lo:104: Request processed in 51us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604292.295836:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787604292.295849:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787604292.295856:0:21903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c179ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+4:24674:x1874438316632960:12345-0@lo:104: 00010000:00010000:2.0:1787604292.295863:0:21903:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ec00/0x6c241a9cc41dd3f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c241a9cc41dd400 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.295899:0:21903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787604292.295905:0:21903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c179ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+4:24674:x1874438316632960:12345-0@lo:104: Request processed in 50us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604292.295911:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787604292.295923:0:21903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787604292.295930:0:21903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c179e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+3:24674:x1874438316633088:12345-0@lo:104: 00010000:00010000:2.0:1787604292.295938:0:21903:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3200/0x6c241a9cc41dd3eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c241a9cc41dd3f2 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.295974:0:21903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787604292.295979:0:21903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c179e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+3:24674:x1874438316633088:12345-0@lo:104: Request processed in 51us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604292.295986:0:21903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1787604292.296007:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787604292.296014:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e000/0x6c241a9cc41dd4d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c241a9cc41dd4d9 expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.296022:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc44e000 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:2.0:1787604292.296026:0:21909:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e000/0x6c241a9cc41dd4d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c241a9cc41dd4d9 expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.296036:0:21909:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e000/0x6c241a9cc41dd4d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c241a9cc41dd4d9 expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787604292.296044:0:21909:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e000/0x6c241a9cc41dd4d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c241a9cc41dd4d9 expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604292.296051:0:21909:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787604292.296096:0:21909:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e000/0x6c241a9cc41dd4d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd4d9 expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.296103:0:21909:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787604292.296129:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e000/0x6c241a9cc41dd4d2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd4d9 expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.296137:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44e000/0x6c241a9cc41dd4d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd4d9 expref: -99 pid: 23954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.296167:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787604292.296170:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd438 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c241a9cc41dd43f expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.296175:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09f89d22c00 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:2.0:1787604292.296178:0:21909:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd438 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c241a9cc41dd43f expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.296185:0:21909:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd438 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c241a9cc41dd43f expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787604292.296192:0:21909:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd438 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c241a9cc41dd43f expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604292.296197:0:21909:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787604292.296211:0:21909:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd438 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd43f expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.296218:0:21909:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787604292.296234:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd438 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd43f expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.296241:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa09f89d22c00/0x6c241a9cc41dd438 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd43f expref: -99 pid: 23232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.296251:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787604292.296254:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ec00/0x6c241a9cc41dd3f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c241a9cc41dd400 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.296270:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc44ec00 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:2.0:1787604292.296273:0:21909:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ec00/0x6c241a9cc41dd3f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c241a9cc41dd400 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.296280:0:21909:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ec00/0x6c241a9cc41dd3f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c241a9cc41dd400 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787604292.296286:0:21909:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ec00/0x6c241a9cc41dd3f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c241a9cc41dd400 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604292.296291:0:21909:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787604292.296304:0:21909:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ec00/0x6c241a9cc41dd3f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd400 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.296309:0:21909:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787604292.296314:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ec00/0x6c241a9cc41dd3f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd400 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.296321:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0a0bc44ec00/0x6c241a9cc41dd3f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd400 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.296330:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787604292.296333:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3200/0x6c241a9cc41dd3eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c241a9cc41dd3f2 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.296339:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0813d3200 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:2.0:1787604292.296341:0:21909:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3200/0x6c241a9cc41dd3eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c241a9cc41dd3f2 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.296361:0:21909:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3200/0x6c241a9cc41dd3eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c241a9cc41dd3f2 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787604292.296367:0:21909:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3200/0x6c241a9cc41dd3eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c241a9cc41dd3f2 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787604292.296372:0:21909:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787604292.296396:0:21909:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3200/0x6c241a9cc41dd3eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd3f2 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.296403:0:21909:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787604292.296410:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3200/0x6c241a9cc41dd3eb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd3f2 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.296416:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0a0813d3200/0x6c241a9cc41dd3eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c241a9cc41dd3f2 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.296433:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604292.296435:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604292.296436:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604292.296446:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787604292.296453:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604292.296479:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcf96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3453:1874438316633216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787604292.296523:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604292.296551:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787604292.296558:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcf96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3453:1874438316633600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787604292.296578:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604292.296607:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcf94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3451:1874438316633472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787604292.296646:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604292.296666:0:3451:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787604292.296672:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcf96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3451:1874438316633344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787604292.296728:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604292.296752:0:21906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316633216 00000100:00100000:2.0:1787604292.296758:0:21906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316633216 00010000:00010000:2.0:1787604292.296786:0:21906:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0a0bc44fa00/0x6c241a9cc41dd4d9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c241a9cc41dd4d2 expref: 24 pid: 21914 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604292.296805:0:21906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316633600 00000100:00100000:2.0:1787604292.296808:0:21906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316633600 00010000:00010000:2.0:1787604292.296819:0:21906:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0a080031c00/0x6c241a9cc41dd3f2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c241a9cc41dd3eb expref: 25 pid: 21915 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604292.296829:0:21906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316633472 00000100:00100000:2.0:1787604292.296832:0:21906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316633472 00010000:00010000:2.0:1787604292.296842:0:21906:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa09f89d23000/0x6c241a9cc41dd400 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c241a9cc41dd3f9 expref: 26 pid: 21915 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604292.296853:0:21906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316633344 00000100:00100000:2.0:1787604292.296855:0:21906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316633344 00010000:00010000:2.0:1787604292.296865:0:21906:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0a0813d3000/0x6c241a9cc41dd43f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c241a9cc41dd438 expref: 27 pid: 21914 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604292.296878:0:21906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787604292.296886:0:21906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+27:3453:x1874438316633216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787604292.296897:0:21906:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787604292.296903:0:21906:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0a0bc44fa00/0x6c241a9cc41dd4d9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c241a9cc41dd4d2 expref: 27 pid: 21914 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.296923:0:21906:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0a0bc44fa00/0x6c241a9cc41dd4d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c241a9cc41dd4d2 expref: 27 pid: 21914 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.296942:0:21906:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787604292.296974:0:21906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+27:3453:x1874438316633216:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604292.296981:0:21906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787604292.296998:0:21906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787604292.297005:0:21906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+26:3453:x1874438316633600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787604292.297013:0:21906:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787604292.297018:0:21906:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0a080031c00/0x6c241a9cc41dd3f2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c241a9cc41dd3eb expref: 26 pid: 21915 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.297027:0:21906:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0a080031c00/0x6c241a9cc41dd3f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c241a9cc41dd3eb expref: 26 pid: 21915 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.297037:0:21906:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787604292.297060:0:21906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+26:3453:x1874438316633600:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604292.297067:0:21906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787604292.297079:0:21906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787604292.297085:0:21906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+25:3451:x1874438316633472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787604292.297093:0:21906:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787604292.297098:0:21906:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa09f89d23000/0x6c241a9cc41dd400 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c241a9cc41dd3f9 expref: 25 pid: 21915 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.297106:0:21906:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa09f89d23000/0x6c241a9cc41dd400 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c241a9cc41dd3f9 expref: 25 pid: 21915 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.297124:0:21906:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787604292.297152:0:21906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+25:3451:x1874438316633472:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604292.297158:0:21906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787604292.297171:0:21906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787604292.297177:0:21906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:3451:x1874438316633344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787604292.297184:0:21906:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787604292.297189:0:21906:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0a0813d3000/0x6c241a9cc41dd43f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c241a9cc41dd438 expref: 24 pid: 21914 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.297197:0:21906:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0a0813d3000/0x6c241a9cc41dd43f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c241a9cc41dd438 expref: 24 pid: 21914 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.297206:0:21906:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787604292.297229:0:21906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:3451:x1874438316633344:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604292.297234:0:21906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787604292.297280:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcf96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3451:1874438316633344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787604292.297291:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcf94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3451:1874438316633472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787604292.297319:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcf96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3453:1874438316633600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787604292.297327:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcf96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3453:1874438316633216:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787604292.299450:0:24674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0bc44fa00/0x6c241a9cc41dd4d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c241a9cc41dd4d2 expref: 23 pid: 21914 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604292.299479:0:24674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c179c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24674:1874438316632704:0@lo:104: 00010000:00010000:0.0:1787604292.299494:0:24674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0813d3000/0x6c241a9cc41dd43f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c241a9cc41dd438 expref: 22 pid: 21914 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604292.299506:0:24674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c179ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24674:1874438316632832:0@lo:104: 00010000:00010000:0.0:1787604292.299518:0:24674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa09f89d23000/0x6c241a9cc41dd400 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c241a9cc41dd3f9 expref: 21 pid: 21915 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604292.299527:0:24674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c179ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24674:1874438316632960:0@lo:104: 00010000:00010000:0.0:1787604292.299539:0:24674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a080031c00/0x6c241a9cc41dd3f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c241a9cc41dd3eb expref: 20 pid: 21915 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604292.299548:0:24674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c179f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24674:1874438316633088:0@lo:104: 00000100:00100000:2.0:1787604292.308040:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604292.308095:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604292.308136:0:21907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299741056 00000100:00100000:2.0:1787604292.308168:0:21907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299741056 00010000:00010000:2.0:1787604292.308216:0:21907:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0a0bc41b600/0x6c241a9cc41dd764 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb130 expref: 13 pid: 21914 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604292.308253:0:21907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299741184 00000100:00100000:2.0:1787604292.308257:0:21907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299741184 00010000:00010000:2.0:1787604292.308272:0:21907:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0a083e4b800/0x6c241a9cc41dd725 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb0c0 expref: 14 pid: 21915 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604292.308289:0:21907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 13 00000100:00100000:2.0:1787604292.308300:0:21907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c01c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c318a211-db33-4ebc-b734-b960fe78e3bb+14:2391:x1874438299741056:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787604292.308316:0:21907:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787604292.308398:0:21907:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0a0bc41b600/0x6c241a9cc41dd764 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb130 expref: 14 pid: 21914 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.308414:0:21907:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0a0bc41b600/0x6c241a9cc41dd764 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb130 expref: 14 pid: 21914 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.308443:0:21907:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787604292.308508:0:21907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c01c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c318a211-db33-4ebc-b734-b960fe78e3bb+14:2391:x1874438299741056:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 209us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604292.308515:0:21907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 13 00000100:00100000:2.0:1787604292.308572:0:21907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 14 00000100:00100000:2.0:1787604292.308578:0:21907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c318a211-db33-4ebc-b734-b960fe78e3bb+13:2391:x1874438299741184:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787604292.308586:0:21907:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787604292.308591:0:21907:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0a083e4b800/0x6c241a9cc41dd725 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb0c0 expref: 13 pid: 21915 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.308599:0:21907:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0a083e4b800/0x6c241a9cc41dd725 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb0c0 expref: 13 pid: 21915 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604292.308767:0:24674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0bc41b600/0x6c241a9cc41dd764 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb130 expref: 13 pid: 21914 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604292.308784:0:24674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c179c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24674:1874438316632448:192.168.203.16@tcp:104: 00010000:00010000:0.0:1787604292.308797:0:24674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a083e4b800/0x6c241a9cc41dd725 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb0c0 expref: 12 pid: 21915 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604292.308805:0:24674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0c179f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24674:1874438316632576:192.168.203.16@tcp:104: 00010000:00010000:2.0:1787604292.308887:0:21907:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0a0bc41a400/0x6c241a9cc41dd795 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.308899:0:21907:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a0bc41a400/0x6c241a9cc41dd795 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604292.309934:0:24674:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0a0bc41a400/0x6c241a9cc41dd795 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.310168:0:21907:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0a0bc41a400/0x6c241a9cc41dd795 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.310178:0:21907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0a0bc41a400/0x6c241a9cc41dd795 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.310186:0:21907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0a0bc41a400/0x6c241a9cc41dd795 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.310204:0:21907:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0a0bc41a400/0x6c241a9cc41dd795 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.310211:0:21907:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc41a400 already unused, calling callback (ffffffffc175e230) 00010000:00010000:2.0:1787604292.310216:0:21907:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0a0bc41a400/0x6c241a9cc41dd795 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.310223:0:21907:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0a0bc41a400/0x6c241a9cc41dd795 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.310250:0:21907:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0a0bc41a400/0x6c241a9cc41dd795 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604292.310265:0:21907:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787604292.310935:0:21907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c318a211-db33-4ebc-b734-b960fe78e3bb+11:2391:x1874438299741184:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 2346us (2829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604292.310966:0:21907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 14 00010000:00010000:0.0:1787604292.311245:0:24674:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0a0bc41a400/0x6c241a9cc41dd795 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604292.311256:0:24674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0a0bc41a400/0x6c241a9cc41dd795 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604292.311263:0:24674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0a0bc41a400/0x6c241a9cc41dd795 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787604292.350537:0:21956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787604293.046511:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787604293.483831:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604293.488407:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299741312 00000100:00100000:2.0:1787604293.488558:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299741312 00000100:00100000:2.0:1787604293.489735:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 148 00000100:00100000:2.0:1787604293.489757:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c318a211-db33-4ebc-b734-b960fe78e3bb+11:18378:x1874438299741312:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787604293.489781:0:21915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604293.489808:0:21915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a083e4b600/0x6c241a9cc41dd79c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb168 expref: -99 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604293.489846:0:21915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a083e4b600/0x6c241a9cc41dd79c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb168 expref: 12 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604293.489859:0:21915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a083e4b600/0x6c241a9cc41dd79c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb168 expref: 12 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604293.489870:0:21915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a083e4b600, rc 0) 00000100:00100000:2.0:1787604293.489966:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c318a211-db33-4ebc-b734-b960fe78e3bb+12:18378:x1874438299741312:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 218us (6151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604293.489974:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 148 00000100:00100000:2.0:1787604293.495567:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604293.495725:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299741440 00000100:00100000:1.0:1787604293.495739:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299741440 00000100:00100000:1.0:1787604293.495809:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 149 00000100:00100000:1.0:1787604293.495820:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c318a211-db33-4ebc-b734-b960fe78e3bb+12:18378:x1874438299741440:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787604293.496218:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c318a211-db33-4ebc-b734-b960fe78e3bb+12:18378:x1874438299741440:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 397us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604293.496228:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 149 00000100:00100000:2.0:1787604293.509349:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604293.509914:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299741568 00000100:00100000:0.0:1787604293.509929:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299741568 00000100:00100000:0.0:1787604293.510003:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 150 00000100:00100000:0.0:1787604293.510016:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c318a211-db33-4ebc-b734-b960fe78e3bb+12:18378:x1874438299741568:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787604293.510327:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c318a211-db33-4ebc-b734-b960fe78e3bb+12:18378:x1874438299741568:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 Request processed in 312us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604293.510337:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 150 00000100:00100000:3.0:1787604293.520420:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604293.520822:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299741696 00000100:00100000:1.0:1787604293.520838:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299741696 00000100:00100000:1.0:1787604293.520914:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 151 00000100:00100000:1.0:1787604293.520927:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c318a211-db33-4ebc-b734-b960fe78e3bb+12:18378:x1874438299741696:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787604293.520950:0:21914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604293.520973:0:21914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a0813d3800/0x6c241a9cc41dd7a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb16f expref: -99 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604293.521032:0:21914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a0813d3800/0x6c241a9cc41dd7a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb16f expref: 13 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604293.521047:0:21914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a0813d3800/0x6c241a9cc41dd7a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb16f expref: 13 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604293.521058:0:21914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a0813d3800, rc 0) 00000100:00100000:1.0:1787604293.522566:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c318a211-db33-4ebc-b734-b960fe78e3bb+13:18378:x1874438299741696:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 1632us (2151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604293.522577:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 151 00000100:00100000:2.0:1787604293.529161:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604293.529280:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299741824 00000100:00100000:0.0:1787604293.529295:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299741824 00000100:00100000:0.0:1787604293.529366:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 152 00000100:00100000:0.0:1787604293.529390:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c318a211-db33-4ebc-b734-b960fe78e3bb+13:18378:x1874438299741824:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787604293.530398:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c318a211-db33-4ebc-b734-b960fe78e3bb+13:18378:x1874438299741824:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 1004us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604293.530412:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 152 00000100:00100000:3.0:1787604293.543187:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604293.543573:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299741952 00000100:00100000:1.0:1787604293.543587:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299741952 00000100:00100000:1.0:1787604293.543663:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 153 00000100:00100000:1.0:1787604293.543675:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c318a211-db33-4ebc-b734-b960fe78e3bb+13:18378:x1874438299741952:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787604293.544124:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c318a211-db33-4ebc-b734-b960fe78e3bb+13:18378:x1874438299741952:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 Request processed in 448us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604293.544134:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 153 00000100:00100000:0.0:1787604293.624035:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcf97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316633728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787604293.624145:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604293.624231:0:23236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316633728 00000100:00100000:3.0:1787604293.624243:0:23236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316633728 00000100:00100000:3.0:1787604293.624338:0:23236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787604293.624353:0:23236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c179f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316633728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787604293.624413:0:23236:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787604293.624473:0:23236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c179f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3453:x1874438316633728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604293.624483:0:23236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1787604293.624635:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787604293.624720:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcf97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3453:1874438316633728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787604293.807335:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604293.807741:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299742080 00000100:00100000:3.0:1787604293.807757:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299742080 00000100:00080000:0.0:1787604293.807910:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787604293.807970:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 23 00000100:00100000:3.0:1787604293.807984:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c179c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+6:19001:x1874438299742080:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787604293.808012:0:21922:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604293.808038:0:21922:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030e00/0x6c241a9cc41dd7aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb176 expref: -99 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.808130:0:21922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd7b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.808148:0:21922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd7b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.808162:0:21922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd7b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.808330:0:21922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd7b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.808339:0:21922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd7b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.808347:0:21922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd7b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.813735:0:21922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031600/0x6c241a9cc41dd7bf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.813769:0:21922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031600/0x6c241a9cc41dd7bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.813784:0:21922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031600/0x6c241a9cc41dd7bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787604293.813981:0:21922:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787604293.813987:0:21922:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 2 00000004:00010000:3.0:1787604293.814106:0:21922:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031600/0x6c241a9cc41dd7bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.814124:0:21922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd7b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.814132:0:21922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd7b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.814141:0:21922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd7b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.814163:0:21922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a080031800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1787604293.814170:0:21922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd7b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.814179:0:21922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd7b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.815609:0:21922:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0a082b24f00) 00010000:00010000:3.0:1787604293.815614:0:21922:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787604293.815622:0:21922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd7b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.815629:0:21922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd7b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.815650:0:21922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd7b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.815658:0:21922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd7b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.815666:0:21922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd7b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.815672:0:21922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a080031e00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1787604293.815675:0:21922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd7b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.815683:0:21922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd7b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.817214:0:21922:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffffa0a082b24400) 00010000:00010000:3.0:1787604293.817218:0:21922:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787604293.817225:0:21922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd7b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.817234:0:21922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd7b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.817328:0:21922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030e00/0x6c241a9cc41dd7aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb176 expref: 8 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.817345:0:21922:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031600/0x6c241a9cc41dd7bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb176 expref: 7 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.817354:0:21922:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0a082b24300) 00010000:00010000:3.0:1787604293.817356:0:21922:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787604293.817359:0:21922:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a080031600, rc 0) 00000100:00100000:3.0:1787604293.819073:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c179c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+7:19001:x1874438299742080:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 11076us (11737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604293.819090:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 23 00000100:00100000:2.0:1787604293.830326:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604293.830510:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299742208 00000100:00100000:0.0:1787604293.830525:0:21931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299742208 00000100:00100000:0.0:1787604293.830661:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5 00000100:00100000:0.0:1787604293.830674:0:21931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ee4faca9-8d42-4529-92e3-bb37c4189833+7:19001:x1874438299742208:12345-192.168.203.16@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787604293.830819:0:21931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ee4faca9-8d42-4529-92e3-bb37c4189833+7:19001:x1874438299742208:12345-192.168.203.16@tcp:900:lhsmtool_posix.0 Request processed in 148us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604293.830829:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5 00000100:00100000:2.0:1787604293.835752:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604293.835867:0:21921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299742464 00000100:00100000:3.0:1787604293.835882:0:21921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299742464 00000100:00100000:0.0:1787604293.836116:0:21921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 24 00000100:00100000:0.0:1787604293.836132:0:21921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+7:19001:x1874438299742464:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787604293.836161:0:21921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604293.836192:0:21921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a400/0x6c241a9cc41dd7c6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb17d expref: -99 pid: 21921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604293.836298:0:21921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41b600/0x6c241a9cc41dd7cd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604293.836317:0:21921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41b600/0x6c241a9cc41dd7cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604293.836335:0:21921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41b600/0x6c241a9cc41dd7cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604293.836355:0:21921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41be00/0x6c241a9cc41dd7d4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604293.836401:0:21921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41be00/0x6c241a9cc41dd7d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604293.836408:0:21921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41be00/0x6c241a9cc41dd7d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604293.840261:0:21921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41b000/0x6c241a9cc41dd7db lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604293.840292:0:21921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41b000/0x6c241a9cc41dd7db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604293.840308:0:21921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41b000/0x6c241a9cc41dd7db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787604293.840329:0:21921:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787604293.840803:0:21921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41b600/0x6c241a9cc41dd7cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604293.840815:0:21921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41b600/0x6c241a9cc41dd7cd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604293.840824:0:21921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41b600/0x6c241a9cc41dd7cd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604293.840831:0:21921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc41b600 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1787604293.840837:0:21921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41b600/0x6c241a9cc41dd7cd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604293.840848:0:21921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41b600/0x6c241a9cc41dd7cd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604293.840881:0:21921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0a082b24300) 00010000:00010000:0.0:1787604293.840885:0:21921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787604293.840893:0:21921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41b600/0x6c241a9cc41dd7cd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604293.840900:0:21921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41b600/0x6c241a9cc41dd7cd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604293.842164:0:21921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41be00/0x6c241a9cc41dd7d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604293.842180:0:21921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41be00/0x6c241a9cc41dd7d4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604293.842187:0:21921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41be00/0x6c241a9cc41dd7d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604293.842320:0:21921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc41be00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1787604293.842325:0:21921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41be00/0x6c241a9cc41dd7d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604293.842333:0:21921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41be00/0x6c241a9cc41dd7d4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604293.842349:0:21921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffffa0a09042dc00) 00010000:00010000:0.0:1787604293.842352:0:21921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787604293.842356:0:21921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41be00/0x6c241a9cc41dd7d4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604293.842362:0:21921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41be00/0x6c241a9cc41dd7d4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604293.845432:0:21921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a400/0x6c241a9cc41dd7c6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb17d expref: 10 pid: 21921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604293.845467:0:21921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41b000/0x6c241a9cc41dd7db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb17d expref: 9 pid: 21921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604293.845479:0:21921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0a09042d700) 00010000:00010000:1.0:1787604293.845482:0:21921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787604293.845498:0:21921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a0bc41b000, rc 0) 00000100:00100000:1.0:1787604293.845603:0:21921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+9:19001:x1874438299742464:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 9473us (9863us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1787604293.845613:0:21921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 24 00000100:00100000:0.0:1787604293.849775:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604293.849871:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299742592 00000100:00100000:1.0:1787604293.849886:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299742592 00000100:00100000:1.0:1787604293.849983:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 25 00000100:00100000:1.0:1787604293.849996:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c179f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+9:19001:x1874438299742592:12345-192.168.203.16@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787604293.850320:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c179f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+9:19001:x1874438299742592:12345-192.168.203.16@tcp:59:lhsmtool_posix.0 Request processed in 324us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604293.850329:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 25 00000100:00100000:2.0:1787604293.853494:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604293.853581:0:24644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299742720 00000100:00100000:3.0:1787604293.853594:0:24644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299742720 00000100:00100000:3.0:1787604293.853669:0:24644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 26 00000100:00100000:3.0:1787604293.853681:0:24644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee4faca9-8d42-4529-92e3-bb37c4189833+5:19001:x1874438299742720:12345-192.168.203.16@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1787604293.855307:0:24644:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1544us 00000100:00080000:0.0:1787604293.856548:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787604293.894870:0:24644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee4faca9-8d42-4529-92e3-bb37c4189833+5:19001:x1874438299742720:12345-192.168.203.16@tcp:59:lhsmtool_posix.0 Request processed in 41176us (41371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604293.894888:0:24644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 26 00000100:00100000:2.0:1787604293.908326:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604293.908465:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299742848 00000100:00100000:3.0:1787604293.908496:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299742848 00000100:00100000:3.0:1787604293.908574:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 27 00000100:00100000:3.0:1787604293.908586:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+9:19007:x1874438299742848:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:3.0:1787604293.908614:0:21922:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604293.908642:0:21922:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030e00/0x6c241a9cc41dd7e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb184 expref: -99 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.908783:0:21922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd7f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.908801:0:21922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd7f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.908817:0:21922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd7f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.913928:0:21922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd7f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.913952:0:21922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.913965:0:21922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.914244:0:21922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd7f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.914253:0:21922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd7f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.914260:0:21922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd7f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.914272:0:21922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a080031e00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1787604293.914277:0:21922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd7f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.915676:0:21922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd7f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.915720:0:21922:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0a082b24f00) 00010000:00010000:3.0:1787604293.915724:0:21922:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787604293.915730:0:21922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd7f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.915738:0:21922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd7f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.915756:0:21922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.915761:0:21922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd7f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.915767:0:21922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd7f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.915772:0:21922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a080031800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1787604293.915775:0:21922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd7f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.915781:0:21922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd7f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.915806:0:21922:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffffa0a082b24400) 00010000:00010000:3.0:1787604293.915808:0:21922:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787604293.916797:0:21922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd7f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.916818:0:21922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd7f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.916876:0:21922:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030e00/0x6c241a9cc41dd7e9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb184 expref: 10 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.916888:0:21922:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0a082b24f00) 00010000:00010000:3.0:1787604293.916891:0:21922:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787604293.916895:0:21922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030e00/0x6c241a9cc41dd7e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb184 expref: 10 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.916904:0:21922:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a080030e00, rc 0) 00000100:00100000:3.0:1787604293.917276:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+9:19007:x1874438299742848:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 8690us (8973us total) trans 0 rc 301/301 00000100:00100000:3.0:1787604293.917296:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 27 00000100:00100000:1.0:1787604293.938397:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604293.938994:0:21929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299742976 00000100:00100000:2.0:1787604293.939010:0:21929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299742976 00000100:00100000:2.0:1787604293.939077:0:21929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:2.0:1787604293.939088:0:21929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ee4faca9-8d42-4529-92e3-bb37c4189833+9:19007:x1874438299742976:12345-192.168.203.16@tcp:700:lfs.0 00000100:00100000:2.0:1787604293.940526:0:21929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ee4faca9-8d42-4529-92e3-bb37c4189833+9:19007:x1874438299742976:12345-192.168.203.16@tcp:700:lfs.0 Request processed in 1429us (2146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604293.940541:0:21929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:2.0:1787604293.944939:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604293.945018:0:21921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299743232 00000100:00100000:1.0:1787604293.945028:0:21921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299743232 00000100:00100000:1.0:1787604293.945087:0:21921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 28 00000100:00100000:1.0:1787604293.945098:0:21921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+9:19007:x1874438299743232:12345-192.168.203.16@tcp:36:lfs.0 00010000:00010000:1.0:1787604293.945155:0:21921:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604293.945187:0:21921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030a00/0x6c241a9cc41dd74f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb0f1 expref: 9 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604293.945206:0:21921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0a082b24f00) 00010000:00010000:1.0:1787604293.945211:0:21921:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787604293.947460:0:21921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd7fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604293.947494:0:21921:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4ba00/0x6c241a9cc41dd78e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb161 expref: 5 pid: 21921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604293.947503:0:21921:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd7fe lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604293.947543:0:21921:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4ba00/0x6c241a9cc41dd78e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb161 expref: 5 pid: 21921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604293.947559:0:21921:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4ba00/0x6c241a9cc41dd78e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb161 expref: 5 pid: 21921 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604293.947575:0:21921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcb49880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:21921:1874438316633856:192.168.203.16@tcp:104: 00000100:00100000:1.0:1787604293.947672:0:21921:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a091b7ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787604293.955098:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604293.955266:0:21921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcb49880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:21921:1874438316633856:192.168.203.16@tcp:104: 00010000:00010000:1.0:1787604293.955309:0:21921:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd7fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604293.955465:0:21906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299743360 00000100:00100000:3.0:1787604293.955475:0:21906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299743360 00010000:00010000:3.0:1787604293.955538:0:21906:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4ba00/0x6c241a9cc41dd78e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb161 expref: 6 pid: 21921 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604293.955592:0:21906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 15 00000100:00100000:3.0:1787604293.955603:0:21906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c953df99-c275-42e9-af8a-a6deee3192d9+6:2390:x1874438299743360:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787604293.955654:0:21906:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787604293.955663:0:21906:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4ba00/0x6c241a9cc41dd78e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb161 expref: 6 pid: 21921 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.955676:0:21906:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4ba00/0x6c241a9cc41dd78e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb161 expref: 6 pid: 21921 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.955731:0:21906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4ba00/0x6c241a9cc41dd78e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb161 expref: 6 pid: 21921 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.955752:0:21906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0a082b24f00) 00010000:00010000:3.0:1787604293.955758:0:21906:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd7fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.955769:0:21906:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd7fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.955778:0:21906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd7fe lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604293.955805:0:21906:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787604293.955872:0:21906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c953df99-c275-42e9-af8a-a6deee3192d9+5:2390:x1874438299743360:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 270us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604293.955880:0:21906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 15 00010000:00010000:1.0:1787604293.956102:0:21921:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd7fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604293.956110:0:21921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd7fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604293.956140:0:21921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d2000/0x6c241a9cc41dd805 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604293.956153:0:21921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d2000/0x6c241a9cc41dd805 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604293.956173:0:21921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d2000/0x6c241a9cc41dd805 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787604293.958070:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787604293.966938:0:21921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d2e00/0x6c241a9cc41dd80c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604293.966971:0:21921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d2e00/0x6c241a9cc41dd80c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604293.966984:0:21921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d2e00/0x6c241a9cc41dd80c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787604293.967005:0:21921:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003bee6bf6 reply state 000000005ea4b599 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d2e00/0x6c241a9cc41dd80c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604293.967018:0:21921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d2e00/0x6c241a9cc41dd80c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604293.967026:0:21921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa0a08b6c3400) 00010000:00010000:1.0:1787604293.967030:0:21921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787604293.967034:0:21921:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787604293.967044:0:21921:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 1024 00010000:00010000:1.0:1787604293.967055:0:21921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd7fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604293.967063:0:21921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd7fe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604293.967070:0:21921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd7fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604293.967077:0:21921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0813d3200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1787604293.967111:0:21921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd7fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604293.967120:0:21921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd7fe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604293.967132:0:21921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0a082b24f00) 00010000:00010000:1.0:1787604293.967135:0:21921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787604293.967139:0:21921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd7fe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604293.967148:0:21921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd7fe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787604293.967173:0:21921:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003bee6bf6 reply state 000000005ea4b599 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d2000/0x6c241a9cc41dd805 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604293.967182:0:21921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d2000/0x6c241a9cc41dd805 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604293.967188:0:21921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffffa0a08b6c3b00) 00010000:00010000:1.0:1787604293.967190:0:21921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787604293.967363:0:21921:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1787604293.967526:0:21921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+10:19007:x1874438299743232:12345-192.168.203.16@tcp:36:lfs.0 Request processed in 22421us (22588us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1787604293.967537:0:21921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 28 00010000:00010000:2.0:1787604294.070263:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604294.075534:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604294.076991:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299743488 00000100:00100000:1.0:1787604294.077014:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299743488 00000100:00100000:1.0:1787604294.077352:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 29 00000100:00100000:1.0:1787604294.077378:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+10:19015:x1874438299743488:12345-192.168.203.16@tcp:101:lctl.0 00010000:00010000:1.0:1787604294.077419:0:21920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604294.077481:0:21920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd813 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb18b expref: -99 pid: 21920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.077582:0:21920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3000/0x6c241a9cc41dd81a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.077601:0:21920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3000/0x6c241a9cc41dd81a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.077616:0:21920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3000/0x6c241a9cc41dd81a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787604294.077766:0:21920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787604294.077771:0:21920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 2 00000004:00010000:1.0:1787604294.077832:0:21920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3000/0x6c241a9cc41dd81a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.077866:0:21920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd813 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb18b expref: 12 pid: 21920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.077894:0:21920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3000/0x6c241a9cc41dd81a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb18b expref: 11 pid: 21920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.077905:0:21920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0a08b6c3100) 00010000:00010000:1.0:1787604294.077908:0:21920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787604294.077913:0:21920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a0813d3000, rc 0) 00000100:00100000:1.0:1787604294.078028:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+11:19015:x1874438299743488:12345-192.168.203.16@tcp:101:lctl.0 Request processed in 663us (2509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604294.078038:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 29 00000100:00100000:0.0:1787604294.102346:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604294.102565:0:24644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299743616 00000100:00100000:2.0:1787604294.102580:0:24644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299743616 00000100:00100000:2.0:1787604294.102658:0:24644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 30 00000100:00100000:2.0:1787604294.102671:0:24644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c179ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c953df99-c275-42e9-af8a-a6deee3192d9+5:19016:x1874438299743616:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787604294.102752:0:24644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604294.102779:0:24644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4b200/0x6c241a9cc41dd821 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb192 expref: -99 pid: 24644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.102865:0:24644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4ae00/0x6c241a9cc41dd828 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.102882:0:24644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4ae00/0x6c241a9cc41dd828 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.102895:0:24644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4ae00/0x6c241a9cc41dd828 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787604294.103156:0:24644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787604294.103161:0:24644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 2 00000004:00010000:2.0:1787604294.103262:0:24644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4ae00/0x6c241a9cc41dd828 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.103295:0:24644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4b200/0x6c241a9cc41dd821 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb192 expref: 7 pid: 24644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.103378:0:24644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4ae00/0x6c241a9cc41dd828 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb192 expref: 6 pid: 24644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.103389:0:24644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0a08b6c3100) 00010000:00010000:2.0:1787604294.103393:0:24644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787604294.103397:0:24644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a083e4ae00, rc 0) 00000100:00100000:2.0:1787604294.103485:0:24644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c179ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c953df99-c275-42e9-af8a-a6deee3192d9+6:19016:x1874438299743616:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 816us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604294.103493:0:24644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 30 00000100:00100000:3.0:1787604294.106487:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604294.106642:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299743744 00000100:00100000:0.0:1787604294.106657:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299743744 00000100:00100000:0.0:1787604294.106878:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 31 00000100:00100000:0.0:1787604294.106891:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b6f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c953df99-c275-42e9-af8a-a6deee3192d9+6:19016:x1874438299743744:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:0.0:1787604294.107029:0:21922:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604294.107057:0:21922:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41b400/0x6c241a9cc41dd82f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb199 expref: -99 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.107262:0:21922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ba00/0x6c241a9cc41dd836 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.107280:0:21922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ba00/0x6c241a9cc41dd836 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.107293:0:21922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ba00/0x6c241a9cc41dd836 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.107849:0:21922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a600/0x6c241a9cc41dd83d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.107860:0:21922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a600/0x6c241a9cc41dd83d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.107869:0:21922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a600/0x6c241a9cc41dd83d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.108376:0:21922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ae00/0x6c241a9cc41dd844 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.108391:0:21922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ae00/0x6c241a9cc41dd844 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.108399:0:21922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ae00/0x6c241a9cc41dd844 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787604294.108458:0:21922:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 1024 00000004:00200000:0.0:1787604294.108462:0:21922:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787604294.108490:0:21922:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ae00/0x6c241a9cc41dd844 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.108504:0:21922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ba00/0x6c241a9cc41dd836 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.108511:0:21922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ba00/0x6c241a9cc41dd836 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.108518:0:21922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ba00/0x6c241a9cc41dd836 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.108524:0:21922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc41ba00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1787604294.108529:0:21922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ba00/0x6c241a9cc41dd836 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.108537:0:21922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ba00/0x6c241a9cc41dd836 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.108551:0:21922:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0a08b6c3100) 00010000:00010000:0.0:1787604294.108563:0:21922:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787604294.108569:0:21922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ba00/0x6c241a9cc41dd836 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.108575:0:21922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ba00/0x6c241a9cc41dd836 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.108592:0:21922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a600/0x6c241a9cc41dd83d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.108599:0:21922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a600/0x6c241a9cc41dd83d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.108605:0:21922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a600/0x6c241a9cc41dd83d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.108877:0:21922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc41a600 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1787604294.108881:0:21922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a600/0x6c241a9cc41dd83d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.108889:0:21922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a600/0x6c241a9cc41dd83d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.108898:0:21922:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffffa0a08b6c3b00) 00010000:00010000:0.0:1787604294.108901:0:21922:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787604294.108904:0:21922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a600/0x6c241a9cc41dd83d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.108978:0:21922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a600/0x6c241a9cc41dd83d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.109021:0:21922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41b400/0x6c241a9cc41dd82f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb199 expref: 8 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.109054:0:21922:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ae00/0x6c241a9cc41dd844 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb199 expref: 7 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.109062:0:21922:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa0a08b6c3400) 00010000:00010000:0.0:1787604294.109065:0:21922:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787604294.109068:0:21922:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a0bc41ae00, rc 0) 00000100:00100000:0.0:1787604294.109526:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b6f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c953df99-c275-42e9-af8a-a6deee3192d9+7:19016:x1874438299743744:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 2633us (3226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604294.109536:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 31 00000100:00100000:2.0:1787604294.119976:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604294.120160:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299743872 00000100:00100000:1.0:1787604294.120259:0:21932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299743872 00000100:00100000:1.0:1787604294.120392:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6 00000100:00100000:1.0:1787604294.120406:0:21932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c953df99-c275-42e9-af8a-a6deee3192d9+5:19016:x1874438299743872:12345-192.168.203.16@tcp:900:lfs.0 00000100:00100000:1.0:1787604294.120520:0:21932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c953df99-c275-42e9-af8a-a6deee3192d9+5:19016:x1874438299743872:12345-192.168.203.16@tcp:900:lfs.0 Request processed in 117us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604294.120529:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6 00000100:00080000:0.0:1787604294.122276:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787604294.124645:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604294.124845:0:24644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299744128 00000100:00100000:2.0:1787604294.124861:0:24644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299744128 00000100:00100000:2.0:1787604294.124947:0:24644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 32 00000100:00100000:2.0:1787604294.124961:0:24644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c953df99-c275-42e9-af8a-a6deee3192d9+7:19016:x1874438299744128:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787604294.124988:0:24644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604294.125020:0:24644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4b200/0x6c241a9cc41dd84b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb1a0 expref: -99 pid: 24644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787604294.125201:0:24644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 1024 00010000:00010000:2.0:1787604294.125404:0:24644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4b200/0x6c241a9cc41dd84b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1a0 expref: 9 pid: 24644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.125422:0:24644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0a08b6c3100) 00010000:00010000:2.0:1787604294.125426:0:24644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787604294.125433:0:24644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4b200/0x6c241a9cc41dd84b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1a0 expref: 9 pid: 24644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.125450:0:24644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a083e4b200, rc 0) 00000100:00100000:2.0:1787604294.125537:0:24644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c953df99-c275-42e9-af8a-a6deee3192d9+8:19016:x1874438299744128:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 579us (906us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1787604294.125546:0:24644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 32 00000100:00100000:3.0:1787604294.128423:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604294.128543:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299744384 00000100:00100000:1.0:1787604294.128557:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299744384 00000100:00100000:1.0:1787604294.128630:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 33 00000100:00100000:1.0:1787604294.128644:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b6f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c953df99-c275-42e9-af8a-a6deee3192d9+8:19016:x1874438299744384:12345-192.168.203.16@tcp:36:lfs.0 00010000:00010000:1.0:1787604294.128761:0:21920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604294.128797:0:21920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ae00/0x6c241a9cc41dd844 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb199 expref: 8 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.128821:0:21920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa0a08b6c3400) 00010000:00010000:1.0:1787604294.128828:0:21920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787604294.128862:0:21920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd859 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.128878:0:21920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd859 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.128889:0:21920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd859 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787604294.129200:0:21920:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e09cd4f reply state 0000000092f61414 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd859 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.129236:0:21920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd859 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.129243:0:21920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa0a08b6c3400) 00010000:00010000:1.0:1787604294.129246:0:21920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1787604294.129250:0:21920:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787604294.129267:0:21920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 1024 00000100:00100000:1.0:1787604294.129382:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b6f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c953df99-c275-42e9-af8a-a6deee3192d9+9:19016:x1874438299744384:12345-192.168.203.16@tcp:36:lfs.0 Request processed in 728us (961us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1787604294.129391:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 33 00000100:00100000:3.0:1787604294.133158:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604294.133274:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299744640 00000100:00100000:0.0:1787604294.133289:0:21924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299744640 00000100:00100000:0.0:1787604294.133364:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2 00000100:00100000:0.0:1787604294.133384:0:21924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b6f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c953df99-c275-42e9-af8a-a6deee3192d9+9:19016:x1874438299744640:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:0.0:1787604294.133810:0:21924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b6f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c953df99-c275-42e9-af8a-a6deee3192d9+10:19016:x1874438299744640:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 426us (663us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1787604294.133820:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2 10000000:01000000:2.0:1787604294.133942:0:21917:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787604294.133948:0:21917:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa09f82148800 from 13 10000000:01000000:2.0:1787604294.133953:0:21917:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787604294.134005:0:21917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a083e4b400/0x6c241a9cc41dd860 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.134019:0:21917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0a083e4b400/0x6c241a9cc41dd860 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.134030:0:21917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0a083e4b400/0x6c241a9cc41dd860 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604294.134057:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcf94380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316633984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787604294.134119:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604294.134163:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a088b30480 going to sleep for 11 seconds 00000100:00100000:2.0:1787604294.134184:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316633984 00000100:00100000:2.0:1787604294.134189:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316633984 00000100:00100000:2.0:1787604294.134239:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787604294.134246:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+20:21917:x1874438316633984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787604294.134258:0:21913:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604294.134273:0:21913:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a083e4a600/0x6c241a9cc41dd867 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd860 expref: -99 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.134298:0:21913:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a083e4a600/0x6c241a9cc41dd867 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd860 expref: 21 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.134310:0:21913:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a083e4a600/0x6c241a9cc41dd867 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd860 expref: 21 pid: 21913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.134321:0:21913:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a083e4a600, rc 0) 00000100:00100000:2.0:1787604294.134353:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:21917:x1874438316633984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604294.134360:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787604294.134424:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcf94380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316633984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787604294.134440:0:21917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0a083e4b400/0x6c241a9cc41dd860 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd867 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.134451:0:21917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0a083e4b400/0x6c241a9cc41dd860 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd867 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604294.134507:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcf94380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316634112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787604294.134530:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604294.134542:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a088b30480 going to sleep for 11 seconds 00000100:00100000:1.0:1787604294.134795:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcb4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316634240:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787604294.134831:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604294.134877:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316634240 00000100:00100000:1.0:1787604294.134882:0:21925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316634240 00000100:00100000:1.0:1787604294.134912:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787604294.134919:0:21925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316634240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787604294.134952:0:21925:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787604294.134990:0:21925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316634240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604294.134997:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787604294.135028:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcb4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316634240:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787604294.135045:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316634112 00000100:00100000:1.0:1787604294.135048:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316634112 00000100:00100000:1.0:1787604294.135070:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787604294.135076:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:21917:x1874438316634112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787604294.135352:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:21917:x1874438316634112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 275us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604294.135375:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787604294.135409:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcf94380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316634112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787604294.135436:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcb4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316634368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787604294.135475:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604294.135487:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0897c5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787604294.135497:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316634368 00000100:00100000:1.0:1787604294.135500:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316634368 00000100:00100000:1.0:1787604294.135517:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787604294.135523:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:21917:x1874438316634368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787604294.135667:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:21917:x1874438316634368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604294.135673:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787604294.135730:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcb4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316634368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787604294.136322:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcf94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316634496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787604294.136362:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1787604294.137085:0:22580:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787604294.137234:0:21926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316634496 00000100:00100000:3.0:1787604294.137242:0:21926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316634496 00000100:00100000:3.0:1787604294.137317:0:21926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787604294.137326:0:21926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3451:x1874438316634496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787604294.137381:0:21926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787604294.137461:0:21926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3451:x1874438316634496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604294.137469:0:21926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787604294.137519:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcf94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316634496:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1787604294.139327:0:24689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000100:00100000:2.0:1787604294.141641:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604294.141990:0:24644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299744896 00000100:00100000:3.0:1787604294.142005:0:24644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299744896 00000100:00100000:3.0:1787604294.142083:0:24644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 34 00000100:00100000:3.0:1787604294.142107:0:24644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c953df99-c275-42e9-af8a-a6deee3192d9+10:19016:x1874438299744896:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:3.0:1787604294.142143:0:24644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604294.142172:0:24644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030e00/0x6c241a9cc41dd86e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb1a7 expref: -99 pid: 24644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.142285:0:24644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd875 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.142303:0:24644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd875 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.142316:0:24644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd875 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.142328:0:24644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd87c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.142336:0:24644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd87c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.142356:0:24644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd87c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787604294.142545:0:24644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 1024 00010000:00010000:3.0:1787604294.142666:0:24644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd875 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.142674:0:24644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd875 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.142681:0:24644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd875 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.142732:0:24644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a080031800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1787604294.142737:0:24644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd875 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.142746:0:24644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd875 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.142762:0:24644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0a08b6c3100) 00010000:00010000:3.0:1787604294.142766:0:24644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787604294.142772:0:24644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd875 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.142779:0:24644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd875 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.142796:0:24644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd87c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.142813:0:24644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd87c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.142819:0:24644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd87c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.142824:0:24644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a080031e00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1787604294.142828:0:24644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd87c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.142835:0:24644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd87c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.142843:0:24644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffffa0a08b6c3b00) 00010000:00010000:3.0:1787604294.142846:0:24644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787604294.142849:0:24644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd87c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.142854:0:24644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd87c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.142902:0:24644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030e00/0x6c241a9cc41dd86e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1a7 expref: 12 pid: 24644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.142914:0:24644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0a08b6c3100) 00010000:00010000:3.0:1787604294.142917:0:24644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787604294.142921:0:24644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030e00/0x6c241a9cc41dd86e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1a7 expref: 12 pid: 24644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.142944:0:24644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a080030e00, rc 0) 00000100:00100000:3.0:1787604294.143410:0:24644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c953df99-c275-42e9-af8a-a6deee3192d9+11:19016:x1874438299744896:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 1312us (1779us total) trans 12884901894 rc 301/301 00000100:00100000:3.0:1787604294.143420:0:24644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 34 00000020:01000000:1.0:1787604294.143788:0:21917:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787604294.143824:0:21917:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787604294.143836:0:21917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a083e4b400/0x6c241a9cc41dd860 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd867 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.143847:0:21917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0a083e4b400/0x6c241a9cc41dd860 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd867 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787604294.143859:0:21917:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787604294.143862:0:21917:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0a0aef9a000 from 13 10000000:01000000:1.0:1787604294.143877:0:21917:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787604294.143942:0:21917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a097bf1400/0x6c241a9cc41dd88a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.143951:0:21917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0a097bf1400/0x6c241a9cc41dd88a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.143965:0:21917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0a097bf1400/0x6c241a9cc41dd88a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604294.143998:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcb4bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316634624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787604294.144084:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604294.146427:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0897c5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787604294.150683:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316634624 00000100:00100000:0.0:1787604294.150735:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316634624 00000100:00100000:0.0:1787604294.150833:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787604294.150846:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+21:21917:x1874438316634624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787604294.150867:0:21914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604294.150891:0:21914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a0bc41b400/0x6c241a9cc41dd891 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd88a expref: -99 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.150952:0:21914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a0bc41b400/0x6c241a9cc41dd891 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd88a expref: 22 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.150966:0:21914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a0bc41b400/0x6c241a9cc41dd891 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd88a expref: 22 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.150977:0:21914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a0bc41b400, rc 0) 00000100:00100000:0.0:1787604294.151074:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+22:21917:x1874438316634624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 230us (6989us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604294.151082:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787604294.151629:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcb4bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316634624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787604294.151657:0:21917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0a097bf1400/0x6c241a9cc41dd88a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd891 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.151669:0:21917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0a097bf1400/0x6c241a9cc41dd88a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd891 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604294.151790:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcf97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316634752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787604294.151847:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604294.151891:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08502d240 going to sleep for 11 seconds 00000100:00100000:0.0:1787604294.152047:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316634752 00000100:00100000:0.0:1787604294.152055:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316634752 00000100:00100000:0.0:1787604294.152148:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787604294.152160:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+22:21917:x1874438316634752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787604294.152940:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+22:21917:x1874438316634752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 779us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604294.152950:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787604294.153071:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcf97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316634752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787604294.153130:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcf97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316634880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787604294.153182:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604294.154151:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604294.154640:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08502d240 going to sleep for 11 seconds 00000100:00100000:2.0:1787604294.154813:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299745024 00000100:00100000:2.0:1787604294.154823:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299745024 00000100:00100000:2.0:1787604294.154885:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 35 00000100:00100000:2.0:1787604294.154896:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b6f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c953df99-c275-42e9-af8a-a6deee3192d9+11:19016:x1874438299745024:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787604294.154923:0:21920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604294.154953:0:21920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4b200/0x6c241a9cc41dd898 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb1ae expref: -99 pid: 21920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.155072:0:21920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a400/0x6c241a9cc41dd89f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.155102:0:21920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a400/0x6c241a9cc41dd89f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.155137:0:21920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a400/0x6c241a9cc41dd89f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787604294.155212:0:21920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 1024 00000004:00200000:2.0:1787604294.155217:0:21920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787604294.155248:0:21920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a400/0x6c241a9cc41dd89f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.155285:0:21920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4b200/0x6c241a9cc41dd898 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1ae expref: 13 pid: 21920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.155600:0:21920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a400/0x6c241a9cc41dd89f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1ae expref: 12 pid: 21920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.155612:0:21920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa0a08b6c3400) 00010000:00010000:2.0:1787604294.155615:0:21920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787604294.155620:0:21920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a083e4a400, rc 0) 00000100:00100000:2.0:1787604294.155740:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b6f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c953df99-c275-42e9-af8a-a6deee3192d9+12:19016:x1874438299745024:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 845us (1595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604294.155749:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 35 00000100:00100000:1.0:1787604294.158631:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316634880 00000100:00100000:1.0:1787604294.158655:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316634880 00000100:00100000:1.0:1787604294.158772:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787604294.158786:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f88e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+22:21917:x1874438316634880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787604294.159221:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f88e55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+22:21917:x1874438316634880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 437us (6036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604294.159230:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787604294.159510:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcf97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316634880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787604294.160642:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604294.160910:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299745152 00000100:00100000:3.0:1787604294.160922:0:21924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299745152 00000100:00100000:3.0:1787604294.160988:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 3 00000100:00100000:3.0:1787604294.161000:0:21924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c179ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c953df99-c275-42e9-af8a-a6deee3192d9+12:19016:x1874438299745152:12345-192.168.203.16@tcp:37:lfs.0 00000040:00080000:3.0:1787604294.163456:0:24690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787604294.163909:0:21917:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787604294.163938:0:21917:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787604294.163953:0:21917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a097bf1400/0x6c241a9cc41dd88a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd891 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.163969:0:21917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0a097bf1400/0x6c241a9cc41dd88a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd891 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787604294.163982:0:21917:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787604294.164005:0:21917:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa09f891cd000 from 13 10000000:01000000:1.0:1787604294.164008:0:21917:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787604294.164062:0:21917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a097bf0800/0x6c241a9cc41dd8a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.164071:0:21917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0a097bf0800/0x6c241a9cc41dd8a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.164086:0:21917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0a097bf0800/0x6c241a9cc41dd8a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604294.164185:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcb49f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316635008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787604294.164336:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604294.164439:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0897c5900 going to sleep for 11 seconds 00000100:00100000:0.0:1787604294.168355:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316635008 00000100:00100000:0.0:1787604294.168389:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316635008 00000100:00100000:0.0:1787604294.168485:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787604294.168498:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a04cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+22:21917:x1874438316635008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787604294.168520:0:21914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604294.168545:0:21914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a0bc41a600/0x6c241a9cc41dd8ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd8a6 expref: -99 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.168580:0:21914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a0bc41a600/0x6c241a9cc41dd8ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd8a6 expref: 23 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.168616:0:21914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a0bc41a600/0x6c241a9cc41dd8ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd8a6 expref: 23 pid: 21914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.168627:0:21914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a0bc41a600, rc 0) 00000100:00100000:0.0:1787604294.169004:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a04cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+23:21917:x1874438316635008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 507us (4667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604294.169012:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787604294.169137:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcb49f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316635008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787604294.169163:0:21917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0a097bf0800/0x6c241a9cc41dd8a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd8ad expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.169175:0:21917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0a097bf0800/0x6c241a9cc41dd8a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd8ad expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604294.169280:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcb49f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316635136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787604294.169324:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604294.169387:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0897c5900 going to sleep for 11 seconds 00000100:00100000:0.0:1787604294.169572:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316635136 00000100:00100000:0.0:1787604294.169580:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316635136 00000100:00100000:0.0:1787604294.169620:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787604294.169628:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a04ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+23:21917:x1874438316635136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787604294.170028:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a04ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+23:21917:x1874438316635136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 399us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604294.170038:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787604294.170764:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcb49f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316635136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787604294.170840:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcb49f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316635264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787604294.170938:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604294.170980:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0897c5900 going to sleep for 11 seconds 00000100:00100000:1.0:1787604294.171014:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316635264 00000100:00100000:1.0:1787604294.171022:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316635264 00000100:00100000:1.0:1787604294.171075:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787604294.171346:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a04cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+23:21917:x1874438316635264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787604294.171718:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a04cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57b6d7db-5b8e-4468-b46a-6c89167d0f60+23:21917:x1874438316635264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 630us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604294.171739:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787604294.173658:0:21924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c179ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c953df99-c275-42e9-af8a-a6deee3192d9+12:19016:x1874438299745152:12345-192.168.203.16@tcp:37:lfs.0 Request processed in 12645us (13009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604294.173674:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 3 00000100:00100000:3.0:1787604294.176882:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcb49f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316635264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787604294.177901:0:24691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787604294.178150:0:21917:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787604294.178178:0:21917:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787604294.178203:0:21917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a097bf0800/0x6c241a9cc41dd8a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd8ad expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.178216:0:21917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0a097bf0800/0x6c241a9cc41dd8a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd8ad expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787604294.178229:0:21917:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787604294.178232:0:21917:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0a0bc52f000 from 13 10000000:01000000:1.0:1787604294.178235:0:21917:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787604294.178285:0:21917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a097bf1600/0x6c241a9cc41dd8b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.178293:0:21917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0a097bf1600/0x6c241a9cc41dd8b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.178304:0:21917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0a097bf1600/0x6c241a9cc41dd8b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604294.178335:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcb49180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316635392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787604294.178439:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604294.178516:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0897c5900 going to sleep for 11 seconds 00000100:00100000:3.0:1787604294.178641:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316635392 00000100:00100000:3.0:1787604294.178651:0:21915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316635392 00000100:00100000:3.0:1787604294.178748:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787604294.178761:0:21915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a04ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+23:21917:x1874438316635392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787604294.178780:0:21915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604294.178798:0:21915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0a080030e00/0x6c241a9cc41dd8bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c241a9cc41dd8b4 expref: -99 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.178830:0:21915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0a080030e00/0x6c241a9cc41dd8bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c241a9cc41dd8b4 expref: 24 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.178842:0:21915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0a080030e00/0x6c241a9cc41dd8bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c241a9cc41dd8b4 expref: 24 pid: 21915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.178869:0:21915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a080030e00, rc 0) 00000100:00100000:3.0:1787604294.178922:0:21915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a04ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:21917:x1874438316635392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604294.178929:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787604294.179087:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcb49180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316635392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787604294.179115:0:21917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0a097bf1600/0x6c241a9cc41dd8b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd8bb expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.179125:0:21917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0a097bf1600/0x6c241a9cc41dd8b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c241a9cc41dd8bb expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604294.179309:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcb49180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316635520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787604294.179344:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604294.179383:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0897c5900 going to sleep for 11 seconds 00000100:00100000:1.0:1787604294.179404:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316635520 00000100:00100000:1.0:1787604294.179408:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316635520 00000100:00100000:1.0:1787604294.179445:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787604294.179453:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a08af2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:21917:x1874438316635520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787604294.179831:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a08af2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:21917:x1874438316635520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 377us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604294.179839:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787604294.179879:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcb49180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316635520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787604294.179916:0:21917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcb49180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316635648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787604294.179965:0:21917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604294.179979:0:21917:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0897c5900 going to sleep for 11 seconds 00000100:00100000:1.0:1787604294.179992:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316635648 00000100:00100000:1.0:1787604294.179995:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316635648 00000100:00100000:1.0:1787604294.180014:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787604294.180020:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a08af2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:21917:x1874438316635648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787604294.180496:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604294.180715:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a08af2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:21917:x1874438316635648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 693us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604294.180725:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787604294.180893:0:21917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcb49180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57b6d7db-5b8e-4468-b46a-6c89167d0f60:21917:1874438316635648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787604294.182143:0:24692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787604294.185659:0:21917:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787604294.185752:0:21917:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787604294.185770:0:21917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0a097bf1600/0x6c241a9cc41dd8b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd8bb expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.185785:0:21917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0a097bf1600/0x6c241a9cc41dd8b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c241a9cc41dd8bb expref: -99 pid: 21917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604294.185954:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299745408 00000100:00100000:3.0:1787604294.185970:0:21923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299745408 00000100:00100000:3.0:1787604294.186062:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 4 00000100:00100000:3.0:1787604294.186076:0:21923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a09ea73450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c953df99-c275-42e9-af8a-a6deee3192d9+12:19016:x1874438299745408:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:2.0:1787604294.186789:0:21923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a09ea73450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c953df99-c275-42e9-af8a-a6deee3192d9+13:19016:x1874438299745408:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 713us (6293us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1787604294.186800:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 4 00000100:00100000:2.0:1787604294.272873:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604294.273028:0:21921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299745536 00000100:00100000:0.0:1787604294.273044:0:21921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299745536 00000100:00100000:0.0:1787604294.273176:0:21921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 36 00000100:00100000:0.0:1787604294.273190:0:21921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+11:19022:x1874438299745536:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:0.0:1787604294.273222:0:21921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604294.273248:0:21921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ba00/0x6c241a9cc41dd8c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb1b5 expref: -99 pid: 21921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.273477:0:21921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41aa00/0x6c241a9cc41dd8c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.273494:0:21921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41aa00/0x6c241a9cc41dd8c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.273506:0:21921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41aa00/0x6c241a9cc41dd8c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.273517:0:21921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a800/0x6c241a9cc41dd8d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.273524:0:21921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a800/0x6c241a9cc41dd8d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.273532:0:21921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a800/0x6c241a9cc41dd8d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.273666:0:21921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ae00/0x6c241a9cc41dd8d7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.273674:0:21921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ae00/0x6c241a9cc41dd8d7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.273681:0:21921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ae00/0x6c241a9cc41dd8d7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787604294.274794:0:21921:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 1024 00000004:00200000:2.0:1787604294.274820:0:21921:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787604294.274886:0:21921:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ae00/0x6c241a9cc41dd8d7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.274903:0:21921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41aa00/0x6c241a9cc41dd8c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.274910:0:21921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41aa00/0x6c241a9cc41dd8c9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.274918:0:21921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41aa00/0x6c241a9cc41dd8c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.274924:0:21921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc41aa00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1787604294.274930:0:21921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41aa00/0x6c241a9cc41dd8c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.274938:0:21921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41aa00/0x6c241a9cc41dd8c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.274957:0:21921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0a08b6c3100) 00010000:00010000:2.0:1787604294.274960:0:21921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787604294.274966:0:21921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41aa00/0x6c241a9cc41dd8c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.274972:0:21921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41aa00/0x6c241a9cc41dd8c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.274993:0:21921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a800/0x6c241a9cc41dd8d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.275000:0:21921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a800/0x6c241a9cc41dd8d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.275017:0:21921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a800/0x6c241a9cc41dd8d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.275023:0:21921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc41a800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1787604294.275026:0:21921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a800/0x6c241a9cc41dd8d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.275032:0:21921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a800/0x6c241a9cc41dd8d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.275167:0:21921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffffa0a08b6c3b00) 00010000:00010000:2.0:1787604294.275171:0:21921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787604294.275176:0:21921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a800/0x6c241a9cc41dd8d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.275183:0:21921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a800/0x6c241a9cc41dd8d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.275296:0:21921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ba00/0x6c241a9cc41dd8c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1b5 expref: 13 pid: 21921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.275384:0:21921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ae00/0x6c241a9cc41dd8d7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1b5 expref: 12 pid: 21921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.275393:0:21921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa0a08b6c3400) 00010000:00010000:2.0:1787604294.275395:0:21921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787604294.275398:0:21921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a0bc41ae00, rc 0) 00000100:00100000:2.0:1787604294.275578:0:21921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+12:19022:x1874438299745536:12345-192.168.203.16@tcp:101:bash.0 Request processed in 2388us (2717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604294.275604:0:21921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 36 00000100:00100000:3.0:1787604294.278795:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604294.278901:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299745664 00000100:00100000:1.0:1787604294.278916:0:21932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299745664 00000100:00100000:1.0:1787604294.278999:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:1.0:1787604294.279012:0:21932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b6f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ee4faca9-8d42-4529-92e3-bb37c4189833+5:19022:x1874438299745664:12345-192.168.203.16@tcp:900:bash.0 00000100:00100000:1.0:1787604294.279441:0:21932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b6f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ee4faca9-8d42-4529-92e3-bb37c4189833+5:19022:x1874438299745664:12345-192.168.203.16@tcp:900:bash.0 Request processed in 429us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604294.279452:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:3.0:1787604294.282057:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604294.282560:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299745920 00000100:00100000:2.0:1787604294.282580:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299745920 00000100:00100000:2.0:1787604294.282779:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 37 00000100:00100000:2.0:1787604294.282796:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b6f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+12:19022:x1874438299745920:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:2.0:1787604294.282835:0:21920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604294.282873:0:21920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a000/0x6c241a9cc41dd8de lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb1bc expref: -99 pid: 21920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.283131:0:21920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4b800/0x6c241a9cc41dd8e5 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.283153:0:21920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a400/0x6c241a9cc41dd89f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1ae expref: 12 pid: 21920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.283164:0:21920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4b800/0x6c241a9cc41dd8e5 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.283227:0:21920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a400/0x6c241a9cc41dd89f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1ae expref: 12 pid: 21920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.283244:0:21920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a400/0x6c241a9cc41dd89f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1ae expref: 12 pid: 21920 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604294.283261:0:21920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcf94e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:21920:1874438316635776:192.168.203.16@tcp:104: 00000100:00100000:2.0:1787604294.283537:0:21920:0:(client.c:2715:ptlrpc_set_wait()) set ffffa09f81b41900 going to sleep for 11 seconds 00000100:00100000:2.0:1787604294.287667:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604294.288166:0:21920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcf94e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:21920:1874438316635776:192.168.203.16@tcp:104: 00010000:00010000:1.0:1787604294.288272:0:21920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4b800/0x6c241a9cc41dd8e5 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604294.288420:0:21907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299746048 00000100:00100000:3.0:1787604294.288431:0:21907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299746048 00010000:00010000:3.0:1787604294.288487:0:21907:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a400/0x6c241a9cc41dd89f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1ae expref: 13 pid: 21920 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604294.288538:0:21907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 16 00000100:00100000:3.0:1787604294.288549:0:21907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c953df99-c275-42e9-af8a-a6deee3192d9+13:2391:x1874438299746048:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787604294.288570:0:21907:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787604294.288579:0:21907:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a400/0x6c241a9cc41dd89f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1ae expref: 13 pid: 21920 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.288593:0:21907:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a400/0x6c241a9cc41dd89f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1ae expref: 13 pid: 21920 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.288622:0:21907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a400/0x6c241a9cc41dd89f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1ae expref: 13 pid: 21920 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.288654:0:21907:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa0a08b6c3400) 00010000:00010000:3.0:1787604294.288661:0:21907:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4b800/0x6c241a9cc41dd8e5 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.288672:0:21907:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4b800/0x6c241a9cc41dd8e5 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.288682:0:21907:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4b800/0x6c241a9cc41dd8e5 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.288994:0:21907:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787604294.289177:0:21907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c953df99-c275-42e9-af8a-a6deee3192d9+12:2391:x1874438299746048:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 626us (1524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604294.289186:0:21907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 16 00010000:00010000:1.0:1787604294.289536:0:21920:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4b800/0x6c241a9cc41dd8e5 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.289546:0:21920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4b800/0x6c241a9cc41dd8e5 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.289595:0:21920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1800/0x6c241a9cc41dd8ec lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.289609:0:21920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1800/0x6c241a9cc41dd8ec lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.289618:0:21920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1800/0x6c241a9cc41dd8ec lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.294006:0:21920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1c00/0x6c241a9cc41dd8f3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.294037:0:21920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1c00/0x6c241a9cc41dd8f3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.294051:0:21920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1c00/0x6c241a9cc41dd8f3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787604294.294068:0:21920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787604294.294629:0:21920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4b800/0x6c241a9cc41dd8e5 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.294641:0:21920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4b800/0x6c241a9cc41dd8e5 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.294648:0:21920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4b800/0x6c241a9cc41dd8e5 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.294655:0:21920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a083e4b800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1787604294.294661:0:21920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4b800/0x6c241a9cc41dd8e5 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.294725:0:21920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4b800/0x6c241a9cc41dd8e5 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.294743:0:21920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa0a08b6c3400) 00010000:00010000:1.0:1787604294.294747:0:21920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787604294.294753:0:21920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4b800/0x6c241a9cc41dd8e5 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.294759:0:21920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4b800/0x6c241a9cc41dd8e5 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787604294.294780:0:21920:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e511592 reply state 000000000644f327 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1800/0x6c241a9cc41dd8ec lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.294794:0:21920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1800/0x6c241a9cc41dd8ec lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.294800:0:21920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffffa0a08b6c3f00) 00010000:00010000:1.0:1787604294.294803:0:21920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787604294.294807:0:21920:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787604294.294859:0:21920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a000/0x6c241a9cc41dd8de lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1bc expref: 15 pid: 21920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.294877:0:21920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1c00/0x6c241a9cc41dd8f3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1bc expref: 14 pid: 21920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.294886:0:21920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0a08b6c3d00) 00010000:00010000:1.0:1787604294.294888:0:21920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787604294.294891:0:21920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a097bf1c00, rc 0) 00000100:00100000:1.0:1787604294.294986:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b6f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+15:19022:x1874438299745920:12345-192.168.203.16@tcp:101:bash.0 Request processed in 12193us (12952us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1787604294.294996:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 37 00000100:00100000:2.0:1787604294.314201:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604294.314524:0:24644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299746176 00000100:00100000:3.0:1787604294.314537:0:24644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299746176 00000100:00100000:3.0:1787604294.314608:0:24644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 38 00000100:00100000:3.0:1787604294.314620:0:24644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee4faca9-8d42-4529-92e3-bb37c4189833+15:19022:x1874438299746176:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:3.0:1787604294.314657:0:24644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604294.314904:0:24644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd901 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb1c3 expref: -99 pid: 24644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.315003:0:24644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd908 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.315020:0:24644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd908 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.315436:0:24644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd908 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787604294.315496:0:24644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787604294.315502:0:24644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787604294.315533:0:24644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd908 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.315545:0:24644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd908 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.315576:0:24644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd901 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1c3 expref: 17 pid: 24644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.315601:0:24644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd908 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1c3 expref: 16 pid: 24644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.315611:0:24644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0a08b6c3d00) 00010000:00010000:3.0:1787604294.315615:0:24644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787604294.315619:0:24644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a080031800, rc 0) 00000100:00100000:3.0:1787604294.318395:0:24644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee4faca9-8d42-4529-92e3-bb37c4189833+16:19022:x1874438299746176:12345-192.168.203.16@tcp:101:bash.0 Request processed in 3747us (4178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604294.318414:0:24644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 38 00000100:00100000:0.0:1787604294.325450:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604294.325681:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299746432 00000100:00100000:3.0:1787604294.325741:0:21924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299746432 00000100:00100000:3.0:1787604294.325820:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5 00000100:00100000:3.0:1787604294.325833:0:21924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c179c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+16:19022:x1874438299746432:12345-192.168.203.16@tcp:35:bash.0 00000100:00100000:3.0:1787604294.326324:0:21924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c179c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+17:19022:x1874438299746432:12345-192.168.203.16@tcp:35:bash.0 Request processed in 490us (887us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1787604294.326351:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5 00000040:00080000:1.0:1787604294.390429:0:21956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787604294.426566:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604294.426680:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299746688 00000100:00100000:3.0:1787604294.426734:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299746688 00000100:00100000:3.0:1787604294.426815:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 39 00000100:00100000:3.0:1787604294.426827:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+17:19032:x1874438299746688:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:3.0:1787604294.426861:0:21922:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604294.426889:0:21922:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd90f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb1ca expref: -99 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787604294.427072:0:21922:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 1024 00010000:00010000:3.0:1787604294.427239:0:21922:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd90f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1ca expref: 19 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.427258:0:21922:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0a08b6c3100) 00010000:00010000:3.0:1787604294.427261:0:21922:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787604294.427268:0:21922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd90f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1ca expref: 19 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.427286:0:21922:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a080031e00, rc 0) 00000100:00100000:3.0:1787604294.427359:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+18:19032:x1874438299746688:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 533us (808us total) trans 12884901898 rc 301/301 00000100:00100000:3.0:1787604294.427381:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 39 00000100:00100000:0.0:1787604294.432568:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604294.432758:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299746944 00000100:00100000:3.0:1787604294.432772:0:21924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299746944 00000100:00100000:3.0:1787604294.432846:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6 00000100:00100000:3.0:1787604294.432859:0:21924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c179ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+18:19032:x1874438299746944:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:3.0:1787604294.433658:0:21924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c179ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+19:19032:x1874438299746944:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 796us (1099us total) trans 12884901899 rc 0/0 00000100:00100000:3.0:1787604294.433671:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6 00000100:00100000:0.0:1787604294.480604:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604294.480791:0:21921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299747200 00000100:00100000:2.0:1787604294.480805:0:21921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299747200 00000100:00100000:2.0:1787604294.480884:0:21921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 40 00000100:00100000:2.0:1787604294.480897:0:21921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a084f13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+19:19035:x1874438299747200:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787604294.480933:0:21921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604294.480961:0:21921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4ac00/0x6c241a9cc41dd91d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb1d1 expref: -99 pid: 21921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.481110:0:21921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a200/0x6c241a9cc41dd924 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.481127:0:21921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a200/0x6c241a9cc41dd924 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.481139:0:21921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a200/0x6c241a9cc41dd924 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787604294.481152:0:21921:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787604294.481335:0:21921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4ac00/0x6c241a9cc41dd91d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1d1 expref: 22 pid: 21921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.481357:0:21921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a200/0x6c241a9cc41dd924 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1d1 expref: 21 pid: 21921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.481377:0:21921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0a08b6c3d00) 00010000:00010000:2.0:1787604294.481381:0:21921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787604294.481386:0:21921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a083e4a200, rc 0) 00000100:00100000:2.0:1787604294.481476:0:21921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a084f13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+21:19035:x1874438299747200:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 580us (888us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1787604294.481484:0:21921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 40 00000100:00100000:0.0:1787604294.485795:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604294.485879:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604294.486083:0:21905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299747456 00000100:00100000:2.0:1787604294.486109:0:21905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299747456 00000100:00100000:2.0:1787604294.486207:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:2.0:1787604294.486220:0:21905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0c04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+21:2393:x1874438299747456:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787604294.486242:0:21905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787604294.486278:0:21905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a200/0x6c241a9cc41dd924 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1d1 expref: 21 pid: 21921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.486311:0:21905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0a08b6c3d00) 00010000:00010000:2.0:1787604294.486318:0:21905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787604294.486405:0:21905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0c04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+20:2393:x1874438299747456:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 186us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604294.486413:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:3.0:1787604294.487252:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299747328 00000100:00100000:3.0:1787604294.487262:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299747328 00000100:00100000:3.0:1787604294.487326:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 41 00000100:00100000:3.0:1787604294.487337:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0c07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+20:19035:x1874438299747328:12345-192.168.203.16@tcp:54:lfs.0 00010000:00010000:3.0:1787604294.487438:0:21922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd932 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.487458:0:21922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd932 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.487472:0:21922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd932 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.487507:0:21922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd932 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.487515:0:21922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd932 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.487522:0:21922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd932 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.487529:0:21922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a080031e00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1787604294.487534:0:21922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd932 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.487542:0:21922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd932 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.487569:0:21922:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0a08b6c3d00) 00010000:00010000:3.0:1787604294.487572:0:21922:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787604294.487576:0:21922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd932 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.487583:0:21922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd932 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604294.487662:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0c07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+20:19035:x1874438299747328:12345-192.168.203.16@tcp:54:lfs.0 Request processed in 327us (1884us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604294.487670:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 41 00000100:00100000:0.0:1787604294.491585:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604294.491669:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299747712 00000100:00100000:3.0:1787604294.491716:0:21924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299747712 00000100:00100000:3.0:1787604294.491781:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:3.0:1787604294.491793:0:21924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0c07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+20:19035:x1874438299747712:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:3.0:1787604294.492099:0:21924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0c07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+21:19035:x1874438299747712:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 307us (528us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1787604294.492108:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:0.0:1787604294.800989:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604294.804154:0:21921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299747968 00000100:00100000:2.0:1787604294.804175:0:21921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299747968 00000100:00100000:2.0:1787604294.804371:0:21921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 42 00000100:00100000:2.0:1787604294.804385:0:21921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0c07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+21:19066:x1874438299747968:12345-192.168.203.16@tcp:101:cat.0 00010000:00010000:2.0:1787604294.804417:0:21921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604294.804445:0:21921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a200/0x6c241a9cc41dd939 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb1d8 expref: -99 pid: 21921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.804580:0:21921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4ac00/0x6c241a9cc41dd940 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.804627:0:21921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4ac00/0x6c241a9cc41dd940 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.804641:0:21921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4ac00/0x6c241a9cc41dd940 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787604294.804657:0:21921:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787604294.804889:0:21921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a200/0x6c241a9cc41dd939 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1d8 expref: 24 pid: 21921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.804914:0:21921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4ac00/0x6c241a9cc41dd940 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1d8 expref: 23 pid: 21921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.804924:0:21921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0a08b6c3d00) 00010000:00010000:2.0:1787604294.804927:0:21921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787604294.804932:0:21921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a083e4ac00, rc 0) 00000100:00100000:2.0:1787604294.805048:0:21921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0c07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+23:19066:x1874438299747968:12345-192.168.203.16@tcp:101:cat.0 Request processed in 666us (4075us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1787604294.805056:0:21921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 42 00000100:00100000:1.0:1787604294.812295:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604294.812450:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299748224 00000100:00100000:3.0:1787604294.812465:0:21924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299748224 00000100:00100000:1.0:1787604294.812518:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604294.812549:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 8 00000100:00100000:3.0:1787604294.812563:0:21924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+23:19066:x1874438299748224:12345-192.168.203.16@tcp:35:cat.0 00000100:00100000:1.0:1787604294.812567:0:21907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299748352 00000100:00100000:1.0:1787604294.812573:0:21907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299748352 00000100:00100000:1.0:1787604294.812722:0:21907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1 00000100:00100000:1.0:1787604294.812734:0:21907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+24:2393:x1874438299748352:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787604294.812749:0:21907:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604294.812781:0:21907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4ac00/0x6c241a9cc41dd940 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1d8 expref: 24 pid: 21921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.812805:0:21907:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0a08b6c3d00) 00010000:00010000:1.0:1787604294.812811:0:21907:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787604294.812875:0:21907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+24:2393:x1874438299748352:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 144us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604294.812883:0:21907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1 00000100:00100000:3.0:1787604294.817369:0:21924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+23:19066:x1874438299748224:12345-192.168.203.16@tcp:35:cat.0 Request processed in 4776us (5057us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1787604294.817387:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 8 00000100:00100000:1.0:1787604294.876502:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604294.876667:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299748608 00000100:00100000:3.0:1787604294.876741:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299748608 00000100:00100000:3.0:1787604294.876858:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 43 00000100:00100000:3.0:1787604294.876873:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+23:19072:x1874438299748608:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:3.0:1787604294.876906:0:21922:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604294.876934:0:21922:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd94e lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb1df expref: -99 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.877069:0:21922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030c00/0x6c241a9cc41dd955 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.877086:0:21922:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1c00/0x6c241a9cc41dd8f3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1bc expref: 24 pid: 21920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.877096:0:21922:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd908 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1c3 expref: 24 pid: 24644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.877105:0:21922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030c00/0x6c241a9cc41dd955 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.877148:0:21922:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd908 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1c3 expref: 24 pid: 24644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.877164:0:21922:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd908 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1c3 expref: 24 pid: 24644 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604294.877179:0:21922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b6f6e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:21922:1874438316635904:192.168.203.16@tcp:104: 00010000:00010000:3.0:1787604294.877289:0:21922:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1c00/0x6c241a9cc41dd8f3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1bc expref: 24 pid: 21920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.877314:0:21922:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1c00/0x6c241a9cc41dd8f3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1bc expref: 24 pid: 21920 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604294.877324:0:21922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b6f6ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:21922:1874438316636032:192.168.203.16@tcp:104: 00000100:00100000:3.0:1787604294.877352:0:21922:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08538e480 going to sleep for 11 seconds 00000100:00100000:3.0:1787604294.881610:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604294.881725:0:21906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299748736 00000100:00100000:0.0:1787604294.881736:0:21906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299748736 00010000:00010000:0.0:1787604294.881787:0:21906:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd908 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1c3 expref: 25 pid: 24644 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604294.881833:0:21906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 17 00000100:00100000:0.0:1787604294.881845:0:21906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b6f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+25:2391:x1874438299748736:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787604294.881863:0:21906:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787604294.881871:0:21906:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd908 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1c3 expref: 25 pid: 24644 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.881888:0:21906:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd908 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1c3 expref: 25 pid: 24644 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.881919:0:21906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0a08b6c3d00) 00010000:00010000:0.0:1787604294.881926:0:21906:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030c00/0x6c241a9cc41dd955 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.881935:0:21906:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030c00/0x6c241a9cc41dd955 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.881942:0:21906:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787604294.882008:0:21906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b6f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+25:2391:x1874438299748736:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 164us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604294.882016:0:21906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 17 00010000:00010000:2.0:1787604294.882270:0:21922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd908 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1c3 expref: 24 pid: 24644 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604294.882291:0:21922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b6f6e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:21922:1874438316635904:192.168.203.16@tcp:104: 00000100:00100000:2.0:1787604294.882304:0:21922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b6f6ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:21922:1874438316636032:192.168.203.16@tcp:104: 00010000:00010000:2.0:1787604294.882330:0:21922:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030c00/0x6c241a9cc41dd955 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604294.883530:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604294.883610:0:21905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299748864 00000100:00100000:1.0:1787604294.883619:0:21905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299748864 00010000:00010000:1.0:1787604294.883661:0:21905:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1c00/0x6c241a9cc41dd8f3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1bc expref: 24 pid: 21920 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604294.883755:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 18 00000100:00100000:1.0:1787604294.883767:0:21905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c01c9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+24:2391:x1874438299748864:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787604294.883798:0:21905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604294.883806:0:21905:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1c00/0x6c241a9cc41dd8f3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1bc expref: 24 pid: 21920 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.883821:0:21905:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1c00/0x6c241a9cc41dd8f3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1bc expref: 24 pid: 21920 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.883844:0:21905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1c00/0x6c241a9cc41dd8f3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1bc expref: 24 pid: 21920 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.883860:0:21905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0a08b6c3d00) 00010000:00010000:1.0:1787604294.883865:0:21905:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030c00/0x6c241a9cc41dd955 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.883876:0:21905:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030c00/0x6c241a9cc41dd955 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.883884:0:21905:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030c00/0x6c241a9cc41dd955 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.883927:0:21905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787604294.883948:0:21922:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030c00/0x6c241a9cc41dd955 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.883960:0:21922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030c00/0x6c241a9cc41dd955 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787604294.883987:0:21922:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000100:00100000:1.0:1787604294.883993:0:21905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c01c9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+23:2391:x1874438299748864:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 226us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604294.884002:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 18 00010000:00010000:2.0:1787604294.884597:0:21922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd94e lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1df expref: 24 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.884618:0:21922:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030c00/0x6c241a9cc41dd955 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1df expref: 23 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.884627:0:21922:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0a08b6c3d00) 00010000:00010000:2.0:1787604294.884630:0:21922:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787604294.884633:0:21922:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a080030c00, rc 0) 00000100:00100000:2.0:1787604294.884720:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+23:19072:x1874438299748608:12345-192.168.203.16@tcp:101:dd.0 Request processed in 7815us (8197us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1787604294.884729:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 43 00000100:00100000:0.0:1787604294.888988:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604294.889122:0:24644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299749120 00000100:00100000:3.0:1787604294.889137:0:24644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299749120 00000100:00100000:3.0:1787604294.889215:0:24644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 44 00000100:00100000:3.0:1787604294.889228:0:24644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0c05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee4faca9-8d42-4529-92e3-bb37c4189833+23:19072:x1874438299749120:12345-192.168.203.16@tcp:36:dd.0 00010000:00010000:3.0:1787604294.889611:0:24644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030a00/0x6c241a9cc41dd963 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.889633:0:24644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030a00/0x6c241a9cc41dd963 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.889646:0:24644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030a00/0x6c241a9cc41dd963 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787604294.889779:0:24644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:3.0:1787604294.889810:0:24644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071ce558d reply state 00000000b03059f3 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030a00/0x6c241a9cc41dd963 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.889824:0:24644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030a00/0x6c241a9cc41dd963 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.889833:0:24644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0a08b6c3d00) 00010000:00010000:3.0:1787604294.889836:0:24644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787604294.889849:0:24644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787604294.889980:0:24644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0c05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee4faca9-8d42-4529-92e3-bb37c4189833+26:19072:x1874438299749120:12345-192.168.203.16@tcp:36:dd.0 Request processed in 752us (1073us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1787604294.889990:0:24644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 44 00000020:00080000:3.0:1787604294.889996:0:24644:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787604294.897762:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604294.897900:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299749248 00000100:00100000:1.0:1787604294.898019:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299749248 00000100:00100000:1.0:1787604294.898096:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 45 00000100:00100000:1.0:1787604294.898108:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0c0c04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+26:19072:x1874438299749248:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:1.0:1787604294.898163:0:21920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604294.898245:0:21920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0600/0x6c241a9cc41dd96a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb1e6 expref: -99 pid: 21920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.898468:0:21920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0600/0x6c241a9cc41dd96a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1e6 expref: 27 pid: 21920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.898487:0:21920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0600/0x6c241a9cc41dd96a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1e6 expref: 27 pid: 21920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604294.898512:0:21920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0a08b6c3d00) 00010000:00010000:1.0:1787604294.898516:0:21920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787604294.898519:0:21920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a097bf0600, rc 0) 00000100:00100000:1.0:1787604294.898602:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0c0c04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+27:19072:x1874438299749248:12345-192.168.203.16@tcp:101:dd.0 Request processed in 495us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604294.898611:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 45 00000100:00100000:0.0:1787604294.909391:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604294.909682:0:21907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299749504 00000100:00100000:3.0:1787604294.909803:0:21907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299749504 00000100:00100000:0.0:1787604294.909976:0:21907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2 00000100:00100000:0.0:1787604294.909990:0:21907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89e09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+27:19072:x1874438299749504:12345-192.168.203.16@tcp:103:dd.0 00010000:00010000:0.0:1787604294.910178:0:21907:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787604294.910212:0:21907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0600/0x6c241a9cc41dd96a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1e6 expref: 27 pid: 21920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604294.910236:0:21907:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0a08b6c3d00) 00010000:00010000:0.0:1787604294.910242:0:21907:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787604294.910472:0:21907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89e09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+26:19072:x1874438299749504:12345-192.168.203.16@tcp:103:dd.0 Request processed in 484us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604294.910481:0:21907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2 00000100:00100000:0.0:1787604294.916035:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604294.916218:0:24644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299749632 00000100:00100000:3.0:1787604294.916232:0:24644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299749632 00000100:00100000:3.0:1787604294.916312:0:24644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 46 00000100:00100000:3.0:1787604294.916325:0:24644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee4faca9-8d42-4529-92e3-bb37c4189833+26:19072:x1874438299749632:12345-192.168.203.16@tcp:58:dd.0 00010000:00010000:3.0:1787604294.916465:0:24644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031c00/0x6c241a9cc41dd971 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.916488:0:24644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031c00/0x6c241a9cc41dd971 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604294.916503:0:24644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031c00/0x6c241a9cc41dd971 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787604294.917725:0:24644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787604294.920905:0:24644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:3.0:1787604294.922273:0:24644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:3.0:1787604294.922745:0:24644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee4faca9-8d42-4529-92e3-bb37c4189833+26:19072:x1874438299749632:12345-192.168.203.16@tcp:58:dd.0 Request processed in 6414us (6718us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604294.922761:0:24644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 46 00000100:00100000:1.0:1787604294.929560:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604294.929751:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299749760 00000100:00100000:2.0:1787604294.929765:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299749760 00000100:00100000:2.0:1787604294.929838:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 47 00000100:00100000:2.0:1787604294.929851:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+26:19072:x1874438299749760:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:2.0:1787604294.929877:0:21922:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604294.929905:0:21922:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a200/0x6c241a9cc41dd978 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb1ed expref: -99 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.929998:0:21922:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031c00/0x6c241a9cc41dd971 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.930021:0:21922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a200/0x6c241a9cc41dd978 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1ed expref: 27 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.930064:0:21922:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031c00/0x6c241a9cc41dd971 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.930080:0:21922:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a200/0x6c241a9cc41dd978 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1ed expref: 27 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.930097:0:21922:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0a08b6c3d00) 00010000:00010000:2.0:1787604294.930101:0:21922:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787604294.930105:0:21922:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a200/0x6c241a9cc41dd978 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1ed expref: 27 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604294.930114:0:21922:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a083e4a200, rc 0) 00000100:00100000:2.0:1787604294.930182:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+27:19072:x1874438299749760:12345-192.168.203.16@tcp:101:dd.0 Request processed in 335us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604294.930203:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 47 00010000:00010000:2.0:1787604295.094160:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787604295.401413:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604295.401471:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604295.401568:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604295.401606:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604295.401677:0:24644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299750016 00000100:00100000:1.0:1787604295.401732:0:24644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299750016 00000100:00100000:1.0:1787604295.401838:0:24644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299750528 00000100:00100000:1.0:1787604295.401842:0:24644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299750528 00000100:00100000:1.0:1787604295.401875:0:24644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 51 00000100:00100000:1.0:1787604295.401887:0:24644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89e09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee4faca9-8d42-4529-92e3-bb37c4189833+27:2390:x1874438299750016:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787604295.401992:0:24644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89e09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee4faca9-8d42-4529-92e3-bb37c4189833+27:2390:x1874438299750016:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 106us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604295.402002:0:24644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 51 00000100:00100000:1.0:1787604295.402022:0:24644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 52 00000100:00100000:1.0:1787604295.402048:0:24644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89e08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c953df99-c275-42e9-af8a-a6deee3192d9+12:2390:x1874438299750528:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787604295.402097:0:24644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89e08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c953df99-c275-42e9-af8a-a6deee3192d9+12:2390:x1874438299750528:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 49us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604295.402104:0:24644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 52 00000100:00080000:1.0:1787604295.402296:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787604295.408010:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604295.408056:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604295.408101:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604295.409521:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299749888 00000100:00100000:0.0:1787604295.409541:0:21914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299749888 00000100:00100000:0.0:1787604295.409630:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 166 00000100:00100000:0.0:1787604295.409644:0:21914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a08af2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c318a211-db33-4ebc-b734-b960fe78e3bb+13:2390:x1874438299749888:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787604295.409773:0:21914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a08af2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c318a211-db33-4ebc-b734-b960fe78e3bb+13:2390:x1874438299749888:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 132us (1780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604295.409806:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 166 00000100:00100000:0.0:1787604295.410021:0:24644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299750144 00000100:00100000:0.0:1787604295.410027:0:24644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299750144 00000100:00080000:0.0:1787604295.410057:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787604295.411191:0:24644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 53 00000100:00100000:0.0:1787604295.411212:0:24644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee4faca9-8d42-4529-92e3-bb37c4189833+5:2390:x1874438299750144:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787604295.411308:0:24644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcb4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee4faca9-8d42-4529-92e3-bb37c4189833+5:2390:x1874438299750144:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 106us (3251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604295.411316:0:24644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 53 00000100:00100000:3.0:1787604295.412787:0:23234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299750272 00000100:00100000:3.0:1787604295.412804:0:23234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299750272 00000100:00080000:0.0:1787604295.412899:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787604295.412911:0:23736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299750784 00000100:00100000:3.0:1787604295.412916:0:23736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299750784 00000100:00080000:0.0:1787604295.412934:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787604295.412958:0:23736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 13 00000100:00100000:3.0:1787604295.413057:0:23736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89e0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee4faca9-8d42-4529-92e3-bb37c4189833+5:2390:x1874438299750272:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787604295.413147:0:23736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89e0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee4faca9-8d42-4529-92e3-bb37c4189833+5:2390:x1874438299750272:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 93us (11674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604295.413198:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604295.413288:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604295.413329:0:23235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299750400 00000100:00100000:1.0:1787604295.413333:0:23235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299750400 00000100:00100000:0.0:1787604295.413392:0:24115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 14 00000100:00080000:0.0:1787604295.413415:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787604295.413430:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299750656 00000100:00100000:0.0:1787604295.413434:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299750656 00000100:00100000:0.0:1787604295.413467:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 54 00000100:00100000:0.0:1787604295.413475:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c953df99-c275-42e9-af8a-a6deee3192d9+5:2390:x1874438299750656:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787604295.413575:0:23233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299750912 00000100:00100000:2.0:1787604295.413580:0:23233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299750912 00000100:00100000:2.0:1787604295.413608:0:23233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 15 00000100:00100000:2.0:1787604295.413616:0:23233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c953df99-c275-42e9-af8a-a6deee3192d9+5:2390:x1874438299750912:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787604295.413755:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c953df99-c275-42e9-af8a-a6deee3192d9+5:2390:x1874438299750656:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 280us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604295.413763:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 54 00000100:00100000:2.0:1787604295.416381:0:23233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c953df99-c275-42e9-af8a-a6deee3192d9+5:2390:x1874438299750912:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 2740us (3067us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604295.416419:0:23233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 15 00000100:00080000:2.0:1787604295.416475:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787604295.416844:0:24115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89e08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c953df99-c275-42e9-af8a-a6deee3192d9+5:2390:x1874438299750784:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787604295.416910:0:24115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89e08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c953df99-c275-42e9-af8a-a6deee3192d9+5:2390:x1874438299750784:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 3510us (15303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604295.416918:0:24115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 14 00000100:00100000:3.0:1787604295.417222:0:23736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 13 00000040:00080000:2.0:1787604295.417400:0:21956:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787604295.417405:0:21956:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787604295.417454:0:21956:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1787604295.417462:0:21956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1787604295.417606:0:21956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcf96d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:21956:1874438316636160:192.168.203.16@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787604295.417676:0:21956:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0bbe69480 going to sleep for 11 seconds 00000100:00100000:1.0:1787604295.418319:0:23235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 16 00000100:00100000:1.0:1787604295.418338:0:23235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+5:2390:x1874438299750400:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787604295.418426:0:23235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+5:2390:x1874438299750400:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 95us (10323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604295.418434:0:23235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 16 00000100:00100000:1.0:1787604295.422774:0:21956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcf96d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:21956:1874438316636160:192.168.203.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787604295.423194:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604295.423334:0:24644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299751040 00000100:00100000:1.0:1787604295.423343:0:24644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299751040 00000100:00100000:1.0:1787604295.423425:0:24644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 48 00000100:00100000:1.0:1787604295.423438:0:24644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee4faca9-8d42-4529-92e3-bb37c4189833+27:19073:x1874438299751040:12345-192.168.203.16@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787604295.423481:0:24644:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787604295.423618:0:24644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee4faca9-8d42-4529-92e3-bb37c4189833+27:19073:x1874438299751040:12345-192.168.203.16@tcp:53:lhsmtool_posix.0 Request processed in 180us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604295.423646:0:24644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 48 00000100:00100000:2.0:1787604295.432743:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604295.432958:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299751168 00000100:00100000:0.0:1787604295.432981:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299751168 00000100:00100000:0.0:1787604295.433272:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 49 00000100:00100000:0.0:1787604295.433288:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+27:19073:x1874438299751168:12345-192.168.203.16@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787604295.433417:0:21922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41aa00/0x6c241a9cc41dd97f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433461:0:21922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41aa00/0x6c241a9cc41dd97f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433476:0:21922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41aa00/0x6c241a9cc41dd97f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433497:0:21922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a800/0x6c241a9cc41dd986 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433505:0:21922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a800/0x6c241a9cc41dd986 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433513:0:21922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a800/0x6c241a9cc41dd986 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433542:0:21922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ba00/0x6c241a9cc41dd98d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433552:0:21922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ba00/0x6c241a9cc41dd98d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433559:0:21922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ba00/0x6c241a9cc41dd98d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787604295.433610:0:21922:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787604295.433616:0:21922:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787604295.433633:0:21922:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ba00/0x6c241a9cc41dd98d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433646:0:21922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41aa00/0x6c241a9cc41dd97f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433664:0:21922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41aa00/0x6c241a9cc41dd97f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433671:0:21922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41aa00/0x6c241a9cc41dd97f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433678:0:21922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc41aa00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1787604295.433683:0:21922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41aa00/0x6c241a9cc41dd97f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433740:0:21922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41aa00/0x6c241a9cc41dd97f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433756:0:21922:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0a09042d700) 00010000:00010000:0.0:1787604295.433759:0:21922:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787604295.433765:0:21922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41aa00/0x6c241a9cc41dd97f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433772:0:21922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41aa00/0x6c241a9cc41dd97f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433789:0:21922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a800/0x6c241a9cc41dd986 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433795:0:21922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a800/0x6c241a9cc41dd986 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433800:0:21922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a800/0x6c241a9cc41dd986 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433805:0:21922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc41a800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1787604295.433814:0:21922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a800/0x6c241a9cc41dd986 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433833:0:21922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a800/0x6c241a9cc41dd986 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433841:0:21922:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffffa0a09042dc00) 00010000:00010000:0.0:1787604295.433844:0:21922:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787604295.433846:0:21922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a800/0x6c241a9cc41dd986 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433852:0:21922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41a800/0x6c241a9cc41dd986 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433871:0:21922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ba00/0x6c241a9cc41dd98d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433877:0:21922:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ba00/0x6c241a9cc41dd98d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433883:0:21922:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ba00/0x6c241a9cc41dd98d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433889:0:21922:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc41ba00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1787604295.433892:0:21922:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ba00/0x6c241a9cc41dd98d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433898:0:21922:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ba00/0x6c241a9cc41dd98d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433904:0:21922:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0a08b6c3d00) 00010000:00010000:0.0:1787604295.433907:0:21922:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787604295.433916:0:21922:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ba00/0x6c241a9cc41dd98d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.433922:0:21922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ba00/0x6c241a9cc41dd98d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604295.434039:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+27:19073:x1874438299751168:12345-192.168.203.16@tcp:34:lhsmtool_posix.0 Request processed in 751us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604295.434048:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 49 00000100:00100000:3.0:1787604295.436782:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604295.438424:0:21921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299751424 00000100:00100000:2.0:1787604295.438442:0:21921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299751424 00000100:00100000:2.0:1787604295.438554:0:21921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 50 00000100:00100000:2.0:1787604295.438569:0:21921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b6f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+27:19073:x1874438299751424:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787604295.438599:0:21921:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604295.438628:0:21921:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4ac00/0x6c241a9cc41dd994 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb1f4 expref: -99 pid: 21921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.438794:0:21921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dd99b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.438812:0:21921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dd99b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.439029:0:21921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dd99b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787604295.439168:0:21921:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787604295.439404:0:21921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dd99b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.439412:0:21921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dd99b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.439420:0:21921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dd99b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.439427:0:21921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a083e4aa00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1787604295.439432:0:21921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dd99b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.439440:0:21921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dd99b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.439456:0:21921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0a08b6c3d00) 00010000:00010000:2.0:1787604295.439459:0:21921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787604295.439464:0:21921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dd99b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.439471:0:21921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dd99b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.439534:0:21921:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4ac00/0x6c241a9cc41dd994 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1f4 expref: 29 pid: 21921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.439560:0:21921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0a09042d700) 00010000:00010000:2.0:1787604295.439562:0:21921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787604295.439567:0:21921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4ac00/0x6c241a9cc41dd994 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1f4 expref: 29 pid: 21921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.439577:0:21921:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a083e4ac00, rc 0) 00000100:00100000:2.0:1787604295.439668:0:21921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b6f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+28:19073:x1874438299751424:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 1102us (2902us total) trans 12884901907 rc 301/301 00000100:00100000:2.0:1787604295.439676:0:21921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 50 00000100:00100000:3.0:1787604295.442850:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604295.443234:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299751552 00000100:00100000:0.0:1787604295.443249:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299751552 00000100:00100000:0.0:1787604295.443321:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 51 00000100:00100000:0.0:1787604295.443334:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b6f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+28:19073:x1874438299751552:12345-192.168.203.16@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787604295.443393:0:21922:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787604295.443528:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b6f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+28:19073:x1874438299751552:12345-192.168.203.16@tcp:53:lhsmtool_posix.0 Request processed in 196us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604295.443537:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 51 00000100:00100000:2.0:1787604295.447271:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604295.448017:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299751808 00000100:00100000:0.0:1787604295.448043:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299751808 00000100:00100000:0.0:1787604295.448143:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 52 00000100:00100000:0.0:1787604295.448157:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+28:19073:x1874438299751808:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787604295.448198:0:21922:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787604295.448229:0:21922:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41b600/0x6c241a9cc41dd9a9 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb1fb expref: -99 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787604295.450034:0:21922:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x23:0x0], count =31 00000004:00080000:0.0:1787604295.450061:0:21922:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x23:0x0]+31 in llog 00000004:00080000:0.0:1787604295.450130:0:21922:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:0.0:1787604295.456356:0:21922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ba00/0x6c241a9cc41dd9b0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.456392:0:21922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ba00/0x6c241a9cc41dd9b0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.456406:0:21922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ba00/0x6c241a9cc41dd9b0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.456565:0:21922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41b600/0x6c241a9cc41dd9a9 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1fb expref: 31 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.456588:0:21922:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ba00/0x6c241a9cc41dd9b0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1fb expref: 30 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.456600:0:21922:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa0a09042dc00) 00010000:00010000:0.0:1787604295.456604:0:21922:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787604295.456608:0:21922:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a0bc41ba00, rc 0) 00000100:00100000:0.0:1787604295.456908:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+30:19073:x1874438299751808:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 8752us (9650us total) trans 12884901908 rc 0/0 00000100:00100000:0.0:1787604295.456920:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 52 00000100:00100000:3.0:1787604295.461637:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604295.462152:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299752064 00000100:00100000:2.0:1787604295.462168:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299752064 00000100:00100000:2.0:1787604295.462254:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 53 00000100:00100000:2.0:1787604295.462269:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b6f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+30:19073:x1874438299752064:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787604295.462960:0:21920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787604295.463000:0:21920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0bc41ba00/0x6c241a9cc41dd9b0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1fb expref: 30 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.463023:0:21920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa0a09042dc00) 00010000:00010000:3.0:1787604295.463587:0:21920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787604295.463624:0:21920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd9be lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.463643:0:21920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd9be lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.463655:0:21920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd9be lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.468251:0:21920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd9c5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x7815455 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.468275:0:21920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd9c5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7815455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.468288:0:21920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd9c5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7815455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.468412:0:21920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd9be lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.468420:0:21920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd9be lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.468427:0:21920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd9be lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.468433:0:21920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a080031e00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1787604295.468437:0:21920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd9be lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.468445:0:21920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd9be lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.468459:0:21920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa0a08b6c3400) 00010000:00010000:3.0:1787604295.468462:0:21920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787604295.468467:0:21920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd9be lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.468473:0:21920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031e00/0x6c241a9cc41dd9be lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.468486:0:21920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd9c5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7815455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.468492:0:21920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd9c5 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7815455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.468497:0:21920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd9c5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7815455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.468511:0:21920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a080031800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:3.0:1787604295.468514:0:21920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd9c5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7815455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.468520:0:21920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd9c5 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7815455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.468527:0:21920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x7815455 (ffffa0a082b24400) 00010000:00010000:3.0:1787604295.468529:0:21920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787604295.468532:0:21920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd9c5 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x7815455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.468538:0:21920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd9c5 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x7815455 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604295.468653:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b6f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+29:19073:x1874438299752064:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 Request processed in 6383us (7026us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787604295.468663:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 53 00000100:00100000:3.0:1787604295.473431:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604295.476173:0:24644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299752192 00000100:00100000:1.0:1787604295.476195:0:24644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299752192 00000100:00100000:1.0:1787604295.476280:0:24644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 54 00000100:00100000:1.0:1787604295.476294:0:24644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b6f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee4faca9-8d42-4529-92e3-bb37c4189833+29:19073:x1874438299752192:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787604295.476323:0:24644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787604295.476371:0:24644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1000/0x6c241a9cc41dd9cc lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb202 expref: -99 pid: 24644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.476423:0:24644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1a00/0x6c241a9cc41dd9d3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.476443:0:24644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1a00/0x6c241a9cc41dd9d3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.476457:0:24644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1a00/0x6c241a9cc41dd9d3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.476615:0:24644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1000/0x6c241a9cc41dd9cc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb202 expref: 31 pid: 24644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.476639:0:24644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1a00/0x6c241a9cc41dd9d3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb202 expref: 30 pid: 24644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.476921:0:24644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa0a08b6c3500) 00010000:00010000:1.0:1787604295.476925:0:24644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787604295.476930:0:24644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a097bf1a00, rc 0) 00000100:00100000:1.0:1787604295.478461:0:24644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b6f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee4faca9-8d42-4529-92e3-bb37c4189833+30:19073:x1874438299752192:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 2153us (5023us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604295.478497:0:24644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 54 00000100:00100000:0.0:1787604295.484434:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604295.484789:0:21921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299752448 00000100:00100000:3.0:1787604295.484803:0:21921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299752448 00000100:00100000:3.0:1787604295.485018:0:21921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 55 00000100:00100000:3.0:1787604295.485031:0:21921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89e0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+30:19073:x1874438299752448:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787604295.485330:0:21921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd9da lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.485350:0:21921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd9da lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.485397:0:21921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd9da lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787604295.487309:0:21921:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:3.0:1787604295.487335:0:21921:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 675624647305ns, next at 676624642406ns, rc = 0 00000004:00010000:3.0:1787604295.487491:0:21921:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8028ee8 reply state 0000000066a7bbc1 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd9da lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.487515:0:21921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd9da lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.487527:0:21921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa0a08b6c3500) 00010000:00010000:3.0:1787604295.487530:0:21921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787604295.487535:0:21921:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787604295.488143:0:21921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89e0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+32:19073:x1874438299752448:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 Request processed in 2659us (3268us total) trans 12884901909 rc 0/0 00000100:00100000:3.0:1787604295.488155:0:21921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 55 00000100:00100000:0.0:1787604295.497984:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604295.501964:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299752576 00000100:00100000:2.0:1787604295.501996:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299752576 00000100:00100000:2.0:1787604295.502097:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 56 00000100:00100000:2.0:1787604295.502112:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+32:19073:x1874438299752576:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787604295.502154:0:21922:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604295.502202:0:21922:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dd9e1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb209 expref: -99 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.502329:0:21922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dd9e1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb209 expref: 33 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.502394:0:21922:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dd9e1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb209 expref: 33 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.502430:0:21922:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa0a08b6c3500) 00010000:00010000:2.0:1787604295.502434:0:21922:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787604295.502439:0:21922:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a083e4aa00, rc 0) 00000100:00100000:2.0:1787604295.502549:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+33:19073:x1874438299752576:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 439us (4584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604295.502558:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 56 00000100:00100000:3.0:1787604295.505656:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604295.508848:0:23234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299752704 00000100:00100000:2.0:1787604295.508872:0:23234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299752704 00000100:00100000:2.0:1787604295.508981:0:23234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 20 00000100:00100000:2.0:1787604295.508995:0:23234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b6f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+5:2390:x1874438299752704:12345-192.168.203.16@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787604295.509524:0:23234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b6f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+6:2390:x1874438299752704:12345-192.168.203.16@tcp:2:lhsmtool_posix.0 Request processed in 530us (3882us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1787604295.509534:0:23234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 20 00000100:00100000:3.0:1787604295.517039:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604295.517203:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299752960 00000100:00100000:0.0:1787604295.517218:0:21923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299752960 00000100:00100000:0.0:1787604295.517293:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 9 00000100:00100000:0.0:1787604295.517304:0:21923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b6f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+33:19073:x1874438299752960:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787604295.517637:0:21923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b6f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+34:19073:x1874438299752960:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 Request processed in 333us (611us total) trans 12884901910 rc 0/0 00000100:00100000:0.0:1787604295.517663:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 9 00000100:00100000:1.0:1787604295.522336:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604295.525249:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299753216 00000100:00100000:0.0:1787604295.525273:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299753216 00000100:00100000:0.0:1787604295.525374:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 57 00000100:00100000:0.0:1787604295.525386:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+34:19073:x1874438299753216:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787604295.525571:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+34:19073:x1874438299753216:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 Request processed in 185us (3250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604295.525580:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 57 00000100:00100000:1.0:1787604295.532766:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604295.532992:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299753344 00000100:00100000:2.0:1787604295.533006:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299753344 00000100:00100000:2.0:1787604295.533081:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 58 00000100:00100000:2.0:1787604295.533094:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+34:19073:x1874438299753344:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787604295.533121:0:21922:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604295.533146:0:21922:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a000/0x6c241a9cc41dd9e8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb210 expref: -99 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.533383:0:21922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4b800/0x6c241a9cc41dd9ef lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.533468:0:21922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4b800/0x6c241a9cc41dd9ef lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.533484:0:21922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4b800/0x6c241a9cc41dd9ef lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787604295.533534:0:21922:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787604295.533558:0:21922:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4b800/0x6c241a9cc41dd9ef lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.533591:0:21922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a000/0x6c241a9cc41dd9e8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb210 expref: 36 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.533612:0:21922:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4b800/0x6c241a9cc41dd9ef lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb210 expref: 35 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.533622:0:21922:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa0a08b6c3500) 00010000:00010000:2.0:1787604295.533626:0:21922:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787604295.533631:0:21922:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a083e4b800, rc 0) 00000100:00100000:2.0:1787604295.533765:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+35:19073:x1874438299753344:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 674us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604295.533774:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 58 00000100:00100000:1.0:1787604295.536857:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604295.537039:0:23736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299753472 00000100:00100000:3.0:1787604295.537052:0:23736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299753472 00000100:00100000:3.0:1787604295.537123:0:23736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 21 00000100:00100000:3.0:1787604295.537135:0:23736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee4faca9-8d42-4529-92e3-bb37c4189833+6:2391:x1874438299753472:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787604295.537158:0:23736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787604295.537198:0:23736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd9f6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb217 expref: -99 pid: 23736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787604295.537233:0:23736:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8cad47, blocks: 0x1 00010000:00010000:3.0:1787604295.537273:0:23736:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=675s v=(0 0) 00010000:00010000:3.0:1787604295.537574:0:23736:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604295.537588:0:23736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd9f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb217 expref: 7 pid: 23736 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.537616:0:23736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd9f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb217 expref: 7 pid: 23736 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.537633:0:23736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a080031e00, rc 0) 00000100:00100000:3.0:1787604295.537755:0:23736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ee4faca9-8d42-4529-92e3-bb37c4189833+7:2391:x1874438299753472:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 621us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604295.537763:0:23736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 21 00000100:00100000:0.0:1787604295.547135:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604295.547385:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299753728 00000100:00100000:3.0:1787604295.547399:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299753728 00000100:00100000:3.0:1787604295.547483:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 59 00000100:00100000:3.0:1787604295.547498:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89e0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+35:19073:x1874438299753728:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787604295.547643:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89e0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+35:19073:x1874438299753728:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 Request processed in 149us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604295.547650:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 59 00000100:00100000:1.0:1787604295.550540:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604295.554188:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299753856 00000100:00100000:2.0:1787604295.554211:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299753856 00000100:00100000:2.0:1787604295.554399:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 60 00000100:00100000:2.0:1787604295.554413:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+35:19073:x1874438299753856:12345-192.168.203.16@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787604295.682583:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+35:19073:x1874438299753856:12345-192.168.203.16@tcp:44:lhsmtool_posix.0 Request processed in 128154us (132050us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604295.682600:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 60 00000001:00080000:3.0:1787604295.682670:0:6460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000001:00080000:3.0:1787604295.682720:0:6460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901893 is committed 00000001:00080000:3.0:1787604295.682759:0:6460:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000004:00080000:3.0:1787604295.682769:0:6460:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787604295.682966:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b6f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3452:1874438316636288:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787604295.683055:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604295.683118:0:23235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316636288 00000100:00100000:3.0:1787604295.683127:0:23235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316636288 00000100:00100000:3.0:1787604295.683201:0:23235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787604295.683211:0:23235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b6f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3452:x1874438316636288:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1787604295.683438:0:3437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd859 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.683451:0:3437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd859 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.683459:0:3437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd859 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.683465:0:3437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0813d3200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1787604295.683470:0:3437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd859 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.683478:0:3437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd859 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.683497:0:3437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa0a08b6c3400) 00010000:00010000:1.0:1787604295.683501:0:3437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1787604295.683507:0:3437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd859 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.683513:0:3437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d3200/0x6c241a9cc41dd859 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787604295.683886:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787604295.684008:0:3436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d2000/0x6c241a9cc41dd805 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684028:0:3436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d2000/0x6c241a9cc41dd805 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684034:0:3436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d2000/0x6c241a9cc41dd805 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684039:0:3436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0813d2000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1787604295.684042:0:3436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d2000/0x6c241a9cc41dd805 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684048:0:3436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d2000/0x6c241a9cc41dd805 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684058:0:3436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffffa0a08b6c3b00) 00010000:00010000:2.0:1787604295.684061:0:3436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787604295.684064:0:3436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d2000/0x6c241a9cc41dd805 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684071:0:3436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d2000/0x6c241a9cc41dd805 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684091:0:3436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d2e00/0x6c241a9cc41dd80c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684097:0:3436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d2e00/0x6c241a9cc41dd80c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684103:0:3436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d2e00/0x6c241a9cc41dd80c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684109:0:3436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0813d2e00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1787604295.684118:0:3436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d2e00/0x6c241a9cc41dd80c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684125:0:3436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d2e00/0x6c241a9cc41dd80c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684134:0:3436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa0a08b6c3400) 00010000:00010000:2.0:1787604295.684136:0:3436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787604295.684139:0:3436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d2e00/0x6c241a9cc41dd80c lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684145:0:3436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a0813d2e00/0x6c241a9cc41dd80c lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684159:0:3436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1800/0x6c241a9cc41dd8ec lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684164:0:3436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1800/0x6c241a9cc41dd8ec lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684170:0:3436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1800/0x6c241a9cc41dd8ec lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684175:0:3436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a097bf1800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1787604295.684178:0:3436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1800/0x6c241a9cc41dd8ec lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684185:0:3436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1800/0x6c241a9cc41dd8ec lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684192:0:3436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffffa0a08b6c3f00) 00010000:00010000:2.0:1787604295.684194:0:3436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787604295.684203:0:3436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1800/0x6c241a9cc41dd8ec lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684209:0:3436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf1800/0x6c241a9cc41dd8ec lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684224:0:3436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030a00/0x6c241a9cc41dd963 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684230:0:3436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030a00/0x6c241a9cc41dd963 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684235:0:3436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030a00/0x6c241a9cc41dd963 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684240:0:3436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a080030a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1787604295.684242:0:3436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030a00/0x6c241a9cc41dd963 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684247:0:3436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030a00/0x6c241a9cc41dd963 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684255:0:3436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0a08b6c3d00) 00010000:00010000:2.0:1787604295.684258:0:3436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787604295.684260:0:3436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030a00/0x6c241a9cc41dd963 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684265:0:3436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080030a00/0x6c241a9cc41dd963 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684275:0:3436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd9da lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684292:0:3436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd9da lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684298:0:3436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd9da lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684303:0:3436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a080031800 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:2.0:1787604295.684307:0:3436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd9da lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684312:0:3436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd9da lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684322:0:3436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa0a08b6c3500) 00010000:00010000:2.0:1787604295.684324:0:3436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787604295.684327:0:3436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd9da lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.684333:0:3436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031800/0x6c241a9cc41dd9da lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21921 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787604295.684672:0:23235:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787604295.684676:0:23235:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787604295.684678:0:23235:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787604295.684680:0:23235:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1787604295 -> 1787604295 00002000:00010000:3.0:1787604295.684683:0:23235:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787604295.684797:0:23235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b6f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3452:x1874438316636288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1585us (1739us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1787604295.684806:0:23235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:1.0:1787604295.684960:0:3452:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0a0b6f6df80/2, rc 0, transno 12884901892 00000100:00100000:1.0:1787604295.684978:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b6f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3452:1874438316636288:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787604295.685882:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604295.686169:0:24115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299753984 00000100:00100000:3.0:1787604295.686179:0:24115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299753984 00000100:00100000:3.0:1787604295.686297:0:24115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 23 00000100:00100000:3.0:1787604295.686310:0:24115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ee4faca9-8d42-4529-92e3-bb37c4189833+7:2390:x1874438299753984:12345-192.168.203.16@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787604295.686456:0:24115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ee4faca9-8d42-4529-92e3-bb37c4189833+7:2390:x1874438299753984:12345-192.168.203.16@tcp:16:lhsmtool_posix.0 Request processed in 148us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604295.686464:0:24115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 23 00000100:00100000:0.0:1787604295.694239:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604295.694383:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299754240 00000100:00100000:3.0:1787604295.694397:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299754240 00000100:00100000:3.0:1787604295.694470:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 61 00000100:00100000:3.0:1787604295.694483:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89e0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+14:19073:x1874438299754240:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787604295.694562:0:21920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787604295.694611:0:21920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4b800/0x6c241a9cc41dd9ef lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb210 expref: 14 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.694635:0:21920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa0a08b6c3500) 00010000:00010000:3.0:1787604295.694642:0:21920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787604295.694723:0:21920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa09f82072200/0x6c241a9cc41dd9fd lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.694741:0:21920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa09f82072200/0x6c241a9cc41dd9fd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.694753:0:21920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa09f82072200/0x6c241a9cc41dd9fd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787604295.695006:0:21920:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093b0ab37 reply state 000000001c7945c2 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffffa09f82072200/0x6c241a9cc41dd9fd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.695021:0:21920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa09f82072200/0x6c241a9cc41dd9fd lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.695028:0:21920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa0a08b6c3500) 00010000:00010000:3.0:1787604295.695031:0:21920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787604295.695035:0:21920:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787604295.695159:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89e0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+15:19073:x1874438299754240:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 Request processed in 677us (934us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1787604295.695168:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 61 00000100:00100000:1.0:1787604295.697598:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604295.697734:0:23233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299754368 00000100:00100000:2.0:1787604295.697747:0:23233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299754368 00000100:00100000:2.0:1787604295.697805:0:23233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 24 00000100:00100000:2.0:1787604295.697815:0:23233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc450700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+7:19073:x1874438299754368:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787604295.697837:0:23233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787604295.697859:0:23233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063464f50/0x6c241a9cc41dda04 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2eef396a646fb21e expref: -99 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.697919:0:23233:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd9f6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb217 expref: 8 pid: 23736 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.697929:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604295.697934:0:23233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604295.697940:0:23233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063464f50/0x6c241a9cc41dda04 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb21e expref: 8 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.697984:0:23233:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd9f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb217 expref: 8 pid: 23736 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.698000:0:23233:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd9f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb217 expref: 8 pid: 23736 timeout: 775 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604295.698017:0:23233:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcf96d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:23233:1874438316636416:192.168.203.16@tcp:104: 00000100:00100000:2.0:1787604295.698123:0:23233:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a086209d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787604295.701771:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604295.701784:0:23233:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcf96d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:23233:1874438316636416:192.168.203.16@tcp:104: 00010000:00010000:2.0:1787604295.701834:0:23233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000063464f50/0x6c241a9cc41dda04 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb21e expref: 8 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.701865:0:23233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0a083e4a000, rc 0) 00000100:00100000:3.0:1787604295.701888:0:21905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299754496 00000100:00100000:3.0:1787604295.701896:0:21905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299754496 00010000:00010000:3.0:1787604295.701935:0:21905:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd9f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb217 expref: 9 pid: 23736 timeout: 775 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604295.701940:0:23233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc450700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+9:19073:x1874438299754368:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 4126us (4358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604295.701967:0:23233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 24 00000100:00100000:3.0:1787604295.701996:0:21905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 19 00000100:00100000:3.0:1787604295.702006:0:21905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc451f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+8:2391:x1874438299754496:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787604295.702023:0:21905:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787604295.702052:0:21905:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd9f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb217 expref: 8 pid: 23736 timeout: 775 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.702068:0:21905:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd9f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb217 expref: 8 pid: 23736 timeout: 775 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.702095:0:21905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9884ee2/0x6c241a9cc41dd9f6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb217 expref: 8 pid: 23736 timeout: 775 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.702157:0:21905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604295.702163:0:21905:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604295.702171:0:21905:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000063464f50/0x6c241a9cc41dda04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb21e expref: 7 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.702184:0:21905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063464f50/0x6c241a9cc41dda04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb21e expref: 7 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.702228:0:21905:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000063464f50/0x6c241a9cc41dda04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb21e expref: 7 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604295.702257:0:21905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:21905:1874438316636544:192.168.203.16@tcp:105: 00000100:00100000:3.0:1787604295.702321:0:21905:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08538e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787604295.705883:0:21905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:21905:1874438316636544:192.168.203.16@tcp:105: 00010000:00010000:3.0:1787604295.705922:0:21905:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787604295.705989:0:21905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc451f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+7:2391:x1874438299754496:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 3982us (4230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604295.706003:0:21905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 19 00000100:00100000:1.0:1787604295.709514:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604295.709590:0:23234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299754624 00000100:00100000:3.0:1787604295.709603:0:23234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299754624 00000100:00100000:3.0:1787604295.709674:0:23234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 25 00000100:00100000:3.0:1787604295.709716:0:23234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f8994a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+7:2391:x1874438299754624:12345-192.168.203.16@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787604295.709974:0:23234:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787604295.709977:0:23234:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1787604295 00002000:00010000:3.0:1787604295.709980:0:23234:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1787604294 00002000:00010000:3.0:1787604295.709983:0:23234:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1787604295 -> 1787604295 00002000:00010000:3.0:1787604295.709985:0:23234:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787604295.710053:0:23234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f8994a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+8:2391:x1874438299754624:12345-192.168.203.16@tcp:2:lhsmtool_posix.0 Request processed in 369us (554us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1787604295.710063:0:23234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 25 00000100:00100000:1.0:1787604295.716013:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604295.716113:0:24115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299754752 00000100:00100000:3.0:1787604295.716127:0:24115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299754752 00000100:00100000:3.0:1787604295.716200:0:24115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 26 00000100:00100000:3.0:1787604295.716214:0:24115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc450380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ee4faca9-8d42-4529-92e3-bb37c4189833+8:2390:x1874438299754752:12345-192.168.203.16@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787604295.716318:0:24115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000094ff6920/0x6c241a9cc41dda0b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.716346:0:24115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000063464f50/0x6c241a9cc41dda04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb21e expref: 8 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.716365:0:24115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604295.716371:0:24115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787604295.716376:0:24115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094ff6920/0x6c241a9cc41dda0b lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.716426:0:24115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000063464f50/0x6c241a9cc41dda04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb21e expref: 8 pid: 23233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.716443:0:24115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000063464f50/0x6c241a9cc41dda04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb21e expref: 8 pid: 23233 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604295.716460:0:24115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0a009ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24115:1874438316636672:192.168.203.16@tcp:104: 00000100:00100000:3.0:1787604295.716569:0:24115:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a08538e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787604295.723662:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604295.723836:0:24115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0a009ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24115:1874438316636672:192.168.203.16@tcp:104: 00010000:00010000:3.0:1787604295.723874:0:24115:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000094ff6920/0x6c241a9cc41dda0b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604295.724052:0:21907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299754880 00000100:00100000:1.0:1787604295.724063:0:21907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299754880 00010000:00010000:1.0:1787604295.724112:0:21907:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000063464f50/0x6c241a9cc41dda04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb21e expref: 9 pid: 23233 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604295.724158:0:21907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 20 00000100:00100000:1.0:1787604295.724170:0:21907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+9:2391:x1874438299754880:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787604295.724189:0:21907:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604295.724219:0:21907:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000063464f50/0x6c241a9cc41dda04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb21e expref: 9 pid: 23233 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.724234:0:21907:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000063464f50/0x6c241a9cc41dda04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb21e expref: 9 pid: 23233 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.724263:0:21907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063464f50/0x6c241a9cc41dda04 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb21e expref: 9 pid: 23233 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.724298:0:21907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787604295.724304:0:21907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787604295.724312:0:21907:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000094ff6920/0x6c241a9cc41dda0b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.724340:0:21907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094ff6920/0x6c241a9cc41dda0b lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.724377:0:21907:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787604295.724451:0:21907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+8:2391:x1874438299754880:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 282us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604295.724458:0:21907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 20 00010000:00010000:3.0:1787604295.724726:0:24115:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000094ff6920/0x6c241a9cc41dda0b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.724750:0:24115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094ff6920/0x6c241a9cc41dda0b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.724780:0:24115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000094ff6920/0x6c241a9cc41dda0b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.724790:0:24115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094ff6920/0x6c241a9cc41dda0b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.724799:0:24115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094ff6920/0x6c241a9cc41dda0b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.724807:0:24115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09f82073400 already unused, calling callback (ffffffffc175e230) 00010000:00010000:3.0:1787604295.724812:0:24115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094ff6920/0x6c241a9cc41dda0b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.724822:0:24115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094ff6920/0x6c241a9cc41dda0b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.724889:0:24115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094ff6920/0x6c241a9cc41dda0b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604295.724898:0:24115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094ff6920/0x6c241a9cc41dda0b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604295.724984:0:24115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc450380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ee4faca9-8d42-4529-92e3-bb37c4189833+7:2390:x1874438299754752:12345-192.168.203.16@tcp:1:lhsmtool_posix.0 Request processed in 8772us (8985us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604295.724993:0:24115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 26 00000100:00100000:0.0:1787604295.726978:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787604295.727064:0:24644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299755136 00000100:00100000:1.0:1787604295.727077:0:24644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299755136 00000100:00100000:1.0:1787604295.727147:0:24644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 62 00000100:00100000:1.0:1787604295.727158:0:24644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee4faca9-8d42-4529-92e3-bb37c4189833+15:19073:x1874438299755136:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787604295.727263:0:24644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0200/0x6c241a9cc41dda12 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.727424:0:24644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0200/0x6c241a9cc41dda12 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.727439:0:24644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0200/0x6c241a9cc41dda12 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.727873:0:24644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0000/0x6c241a9cc41dda19 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.727888:0:24644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dd9e1 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb209 expref: 16 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.727898:0:24644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0000/0x6c241a9cc41dda19 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.727950:0:24644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dd9e1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb209 expref: 16 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.727967:0:24644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dd9e1 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb209 expref: 16 pid: 21922 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604295.727987:0:24644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bc453b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24644:1874438316636800:192.168.203.16@tcp:104: 00000100:00100000:1.0:1787604295.728105:0:24644:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0904cd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787604295.730179:0:24644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bc453b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24644:1874438316636800:192.168.203.16@tcp:104: 00010000:00010000:1.0:1787604295.730228:0:24644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0000/0x6c241a9cc41dda19 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604295.730981:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604295.731062:0:21905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299755264 00000100:00100000:3.0:1787604295.731073:0:21905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299755264 00010000:00010000:3.0:1787604295.731126:0:21905:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dd9e1 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb209 expref: 17 pid: 21922 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604295.731241:0:21907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 21 00000100:00100000:1.0:1787604295.731255:0:21907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89e08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+17:2391:x1874438299755264:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787604295.731336:0:21907:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787604295.731346:0:21907:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dd9e1 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb209 expref: 17 pid: 21922 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.731368:0:21907:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dd9e1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb209 expref: 17 pid: 21922 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.731400:0:21907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dd9e1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb209 expref: 17 pid: 21922 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.731422:0:21907:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa0a08b6c3500) 00010000:00010000:1.0:1787604295.731449:0:21907:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0000/0x6c241a9cc41dda19 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.731461:0:21907:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0000/0x6c241a9cc41dda19 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.731470:0:21907:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0000/0x6c241a9cc41dda19 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.731506:0:21907:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787604295.731578:0:21907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89e08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee4faca9-8d42-4529-92e3-bb37c4189833+16:2391:x1874438299755264:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 326us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604295.731587:0:21907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 21 00010000:00010000:0.0:1787604295.731732:0:24644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0000/0x6c241a9cc41dda19 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.731742:0:24644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0000/0x6c241a9cc41dda19 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787604295.731990:0:24644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:0.0:1787604295.732162:0:24644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:0.0:1787604295.732216:0:24644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:0.0:1787604295.732334:0:24644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89e08000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:24644:1874438316636928:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787604295.732409:0:24644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604295.732443:0:24644:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a082fff540 going to sleep for 11 seconds 00000100:00100000:3.0:1787604295.734804:0:22565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316636928 00000100:00100000:3.0:1787604295.734825:0:22565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316636928 00000100:00100000:3.0:1787604295.734930:0:22565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787604295.734945:0:22565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89e09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:24644:x1874438316636928:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787604295.735109:0:22565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89e09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:24644:x1874438316636928:12345-0@lo:1000:mdt00_003.0 Request processed in 166us (2698us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604295.735118:0:22565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787604295.735263:0:24644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89e08000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:24644:1874438316636928:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787604295.736172:0:24644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:1.0:1787604295.736282:0:24644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bc453b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:24644:1874438316637056:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787604295.736352:0:24644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604295.736398:0:24644:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a0904cd300 going to sleep for 11 seconds 00000100:00100000:0.0:1787604295.736897:0:21926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316637056 00000100:00100000:0.0:1787604295.736917:0:21926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316637056 00000100:00100000:0.0:1787604295.736976:0:21926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787604295.736986:0:21926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc451500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:24644:x1874438316637056:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787604295.737220:0:21926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc451500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:24644:x1874438316637056:12345-0@lo:1000:mdt00_003.0 Request processed in 234us (867us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1787604295.737228:0:21926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787604295.737296:0:24644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bc453b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:24644:1874438316637056:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787604295.737342:0:24644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0000/0x6c241a9cc41dda19 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.737365:0:24644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0000/0x6c241a9cc41dda19 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.737373:0:24644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0000/0x6c241a9cc41dda19 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.737380:0:24644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a097bf0000 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1787604295.737386:0:24644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0000/0x6c241a9cc41dda19 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.737394:0:24644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0000/0x6c241a9cc41dda19 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.737414:0:24644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa0a08b6c3500) 00010000:00010000:0.0:1787604295.737418:0:24644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787604295.737423:0:24644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0000/0x6c241a9cc41dda19 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.737429:0:24644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0000/0x6c241a9cc41dda19 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.737481:0:24644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031c00/0x6c241a9cc41dd971 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.737488:0:24644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031c00/0x6c241a9cc41dd971 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.737494:0:24644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031c00/0x6c241a9cc41dd971 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.737499:0:24644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a080031c00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:0.0:1787604295.737503:0:24644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031c00/0x6c241a9cc41dd971 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.737509:0:24644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031c00/0x6c241a9cc41dd971 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.737518:0:24644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0a08b6c3d00) 00010000:00010000:0.0:1787604295.737521:0:24644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787604295.737530:0:24644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a200/0x6c241a9cc41dd978 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1ed expref: 19 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.737542:0:24644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a200/0x6c241a9cc41dd978 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1ed expref: 19 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.737553:0:24644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a200/0x6c241a9cc41dd978 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1ed expref: 19 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.737612:0:24644:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4a200/0x6c241a9cc41dd978 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x2eef396a646fb1ed expref: 19 pid: 21922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604295.737640:0:24644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa09f89e09880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24644:1874438316637184:192.168.203.16@tcp:105: 00000100:00100000:0.0:1787604295.737755:0:24644:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0a083715240 going to sleep for 11 seconds 00000100:00100000:1.0:1787604295.741465:0:24644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa09f89e09880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24644:1874438316637184:192.168.203.16@tcp:105: 00010000:00010000:1.0:1787604295.741510:0:24644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031c00/0x6c241a9cc41dd971 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.741523:0:24644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a080031c00/0x6c241a9cc41dd971 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.741569:0:24644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0a00/0x6c241a9cc41dda20 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.741585:0:24644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0a00/0x6c241a9cc41dda20 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.741623:0:24644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0a00/0x6c241a9cc41dda20 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.741635:0:24644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0a00/0x6c241a9cc41dda20 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.741642:0:24644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0a00/0x6c241a9cc41dda20 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.741648:0:24644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0a00/0x6c241a9cc41dda20 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.741655:0:24644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a097bf0a00 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1787604295.741659:0:24644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0a00/0x6c241a9cc41dda20 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.741666:0:24644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0a00/0x6c241a9cc41dda20 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.741680:0:24644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0a08b6c3d00) 00010000:00010000:1.0:1787604295.741735:0:24644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787604295.741740:0:24644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0a00/0x6c241a9cc41dda20 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.741746:0:24644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0a00/0x6c241a9cc41dda20 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.741757:0:24644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0200/0x6c241a9cc41dda12 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.741763:0:24644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0200/0x6c241a9cc41dda12 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.741777:0:24644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0200/0x6c241a9cc41dda12 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.741782:0:24644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a097bf0200 already unused, calling callback (ffffffffc21684f0) 00010000:00010000:1.0:1787604295.741786:0:24644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0200/0x6c241a9cc41dda12 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.741793:0:24644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0200/0x6c241a9cc41dda12 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.741802:0:24644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0a08b6c3d00) 00010000:00010000:1.0:1787604295.741804:0:24644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787604295.741807:0:24644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0200/0x6c241a9cc41dda12 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604295.741813:0:24644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a097bf0200/0x6c241a9cc41dda12 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24644 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787604295.742341:0:21956:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787604295.742349:0:21956:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787604295.742390:0:21956:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1787604295.742398:0:21956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1787604295.742626:0:24644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee4faca9-8d42-4529-92e3-bb37c4189833+19:19073:x1874438299755136:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 Request processed in 15464us (15653us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1787604295.742639:0:24644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 62 00000020:00080000:1.0:1787604295.742646:0:24644:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1787604295.747990:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604295.748124:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299755392 00000100:00100000:2.0:1787604295.748138:0:21923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299755392 00000100:00100000:2.0:1787604295.748207:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 10 00000100:00100000:2.0:1787604295.748220:0:21923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a09ea73c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+19:19072:x1874438299755392:12345-192.168.203.16@tcp:49:dd.0 00000100:00100000:0.0:1787604295.748742:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604295.748845:0:21924:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:3.0:1787604295.748858:0:21924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:2.0:1787604295.749489:0:21923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a09ea73c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+19:19072:x1874438299755392:12345-192.168.203.16@tcp:49:dd.0 Request processed in 1055us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604295.749502:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 10 00000100:00100000:2.0:1787604295.749562:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299755648 00000100:00100000:2.0:1787604295.749569:0:21923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299755648 00000100:00100000:2.0:1787604295.749598:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 11 00000100:00100000:2.0:1787604295.749607:0:21923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+19:19073:x1874438299755648:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787604295.754668:0:21923:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787604295.754973:0:21923:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:2.0:1787604295.755076:0:21923:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dda27 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.755099:0:21923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dda27 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 21923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.755113:0:21923:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dda27 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 21923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.755123:0:21923:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dda27 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 21923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.755139:0:21923:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dda27 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 21923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.755146:0:21923:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dda27 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 21923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604295.755179:0:21923:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787604295.755489:0:21909:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787604295.755498:0:21909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dda27 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 21923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.755505:0:21909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a083e4aa00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604295.755509:0:21909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dda27 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 21923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.755517:0:21909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dda27 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 21923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.755534:0:21909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa0a08b6c3500) 00010000:00010000:0.0:1787604295.755537:0:21909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787604295.755543:0:21909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dda27 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 21923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.755548:0:21909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0a083e4aa00/0x6c241a9cc41dda27 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 21923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604295.755561:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604295.755563:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787604295.755565:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604295.755930:0:21923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee4faca9-8d42-4529-92e3-bb37c4189833+21:19073:x1874438299755648:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 Request processed in 6314us (7179us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1787604295.755943:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 11 00000020:00080000:2.0:1787604295.755951:0:21923:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787604296.031539:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604296.031583:0:3444:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604296.031770:0:23240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299755776 00000100:00100000:3.0:1787604296.031785:0:23240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299755776 00000100:00100000:3.0:1787604296.031869:0:23240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299755904 00000100:00100000:3.0:1787604296.031873:0:23240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299755904 00000100:00100000:3.0:1787604296.031896:0:23240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:3.0:1787604296.031909:0:23240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89e09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+8:2391:x1874438299755776:12345-192.168.203.16@tcp:4:dd.0 00002000:00010000:3.0:1787604296.031976:0:23240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a8cad47, atime: 0x6a8cad46, ctime: 0x6a8cad47, blocks: 0x1 00010000:00010000:3.0:1787604296.031990:0:23240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094ff6920/0x6c241a9cc41dda2e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604296.032034:0:23240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=676s v=(0 0) 00010000:00010000:3.0:1787604296.032040:0:23240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604296.032048:0:23240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094ff6920/0x6c241a9cc41dda2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604296.032068:0:23240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094ff6920/0x6c241a9cc41dda2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604296.039044:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787604296.039562:0:3443:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787604296.039732:0:23239:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787604296.039745:0:23239:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1787604296.040257:0:23239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299756032 00000100:00100000:2.0:1787604296.040269:0:23239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299756032 00000100:00100000:2.0:1787604296.040334:0:23239:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787604296.040342:0:23239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299756160 00000100:00100000:2.0:1787604296.040345:0:23239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299756160 00000100:00100000:0.0:1787604296.041349:0:24694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1 00000100:00100000:0.0:1787604296.041377:0:24694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89e08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ee4faca9-8d42-4529-92e3-bb37c4189833+11:2391:x1874438299755904:12345-192.168.203.16@tcp:4:dd.0 00010000:00010000:0.0:1787604296.041630:0:24694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084131a78/0x6c241a9cc41dda35 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604296.041657:0:24694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604296.041663:0:24694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787604296.041671:0:24694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084131a78/0x6c241a9cc41dda35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604296.041960:0:24694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084131a78/0x6c241a9cc41dda35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604296.045323:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604296.045652:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604296.045673:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604296.045720:0:3445:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787604296.045751:0:23241:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787604296.045763:0:23241:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1787604296.045789:0:23239:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787604296.045799:0:23239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299756288 00000100:00100000:3.0:1787604296.045811:0:23239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299756288 00000100:00100000:3.0:1787604296.045877:0:23239:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787604296.045883:0:23239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299756416 00000100:00100000:3.0:1787604296.045885:0:23239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299756416 00000100:00100000:3.0:1787604296.045898:0:23239:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787604296.045903:0:23239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299756544 00000100:00100000:3.0:1787604296.045905:0:23239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299756544 00000100:00100000:3.0:1787604296.045915:0:23239:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787604296.045920:0:23239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438299756672 00000100:00100000:3.0:1787604296.045922:0:23239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438299756672 00000100:00100000:3.0:1787604296.082156:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2 00000100:00100000:3.0:1787604296.082177:0:24695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89e08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ee4faca9-8d42-4529-92e3-bb37c4189833+16:2390:x1874438299756032:12345-192.168.203.16@tcp:4:dd.0 00010000:00010000:3.0:1787604296.082220:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023b66518/0x6c241a9cc41dda3c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604296.082246:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604296.082251:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604296.082260:0:24695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023b66518/0x6c241a9cc41dda3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604296.082276:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023b66518/0x6c241a9cc41dda3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604296.118585:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787604296.208740:0:23240:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:1.0:1787604296.208756:0:23240:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 1787604295 -> 1787604296 00002000:00010000:1.0:1787604296.208759:0:23240:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1787604295 -> 1787604296 00002000:00010000:1.0:1787604296.208761:0:23240:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 1 -> 6151 00010000:00010000:1.0:1787604296.208781:0:23240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094ff6920/0x6c241a9cc41dda2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604296.208821:0:23240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094ff6920/0x6c241a9cc41dda2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604296.208831:0:23240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094ff6920/0x6c241a9cc41dda2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604296.208838:0:23240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09f82073400 already unused, calling callback (ffffffffc175e230) 00010000:00010000:1.0:1787604296.208844:0:23240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094ff6920/0x6c241a9cc41dda2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604296.208854:0:23240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094ff6920/0x6c241a9cc41dda2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604296.208880:0:23240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094ff6920/0x6c241a9cc41dda2e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604296.208889:0:23240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094ff6920/0x6c241a9cc41dda2e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604296.209015:0:23240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89e09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+22:2391:x1874438299755776:12345-192.168.203.16@tcp:4:dd.0 Request processed in 177100us (177484us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1787604296.209032:0:23240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:1.0:1787604296.209078:0:23240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 3 00000100:00100000:1.0:1787604296.209094:0:23240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa09f89e0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+21:2390:x1874438299756160:12345-192.168.203.16@tcp:4:dd.0 00010000:00010000:1.0:1787604296.209132:0:23240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009db6a943/0x6c241a9cc41dda43 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604296.209152:0:23240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787604296.209157:0:23240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787604296.209166:0:23240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009db6a943/0x6c241a9cc41dda43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604296.209194:0:23240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009db6a943/0x6c241a9cc41dda43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787604296.209529:0:9030:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00000001:00080000:3.0:1787604296.209551:0:9030:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:3.0:1787604296.209566:0:9030:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901897 is committed 00010000:00010000:2.0:1787604296.209840:0:24694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084131a78/0x6c241a9cc41dda35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604296.209852:0:24694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084131a78/0x6c241a9cc41dda35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604296.209859:0:24694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084131a78/0x6c241a9cc41dda35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604296.209866:0:24694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a0bc41a000 already unused, calling callback (ffffffffc175e230) 00010000:00010000:2.0:1787604296.209880:0:24694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084131a78/0x6c241a9cc41dda35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604296.209887:0:24694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084131a78/0x6c241a9cc41dda35 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604296.209901:0:24694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084131a78/0x6c241a9cc41dda35 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604296.209908:0:24694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084131a78/0x6c241a9cc41dda35 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604296.209978:0:24694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89e08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ee4faca9-8d42-4529-92e3-bb37c4189833+12:2391:x1874438299755904:12345-192.168.203.16@tcp:4:dd.0 Request processed in 168605us (178391us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1787604296.209987:0:24694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1 00000100:00100000:2.0:1787604296.210011:0:24694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 4 00000100:00100000:2.0:1787604296.210021:0:24694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a009ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ee4faca9-8d42-4529-92e3-bb37c4189833+11:2391:x1874438299756288:12345-192.168.203.16@tcp:4:dd.0 00010000:00010000:2.0:1787604296.210044:0:24694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d216add0/0x6c241a9cc41dda4a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604296.210054:0:24694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604296.210058:0:24694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604296.210063:0:24694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d216add0/0x6c241a9cc41dda4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604296.210074:0:24694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d216add0/0x6c241a9cc41dda4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604296.210924:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023b66518/0x6c241a9cc41dda3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604296.210939:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023b66518/0x6c241a9cc41dda3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604296.210948:0:24695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023b66518/0x6c241a9cc41dda3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604296.210955:0:24695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09f82072e00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:2.0:1787604296.210960:0:24695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023b66518/0x6c241a9cc41dda3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604296.210968:0:24695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023b66518/0x6c241a9cc41dda3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604296.210983:0:24695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023b66518/0x6c241a9cc41dda3c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604296.210991:0:24695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023b66518/0x6c241a9cc41dda3c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604296.211064:0:24695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89e08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ee4faca9-8d42-4529-92e3-bb37c4189833+11:2390:x1874438299756032:12345-192.168.203.16@tcp:4:dd.0 Request processed in 128891us (172652us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1787604296.211073:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2 00000100:00100000:2.0:1787604296.211125:0:24695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5 00000100:00100000:2.0:1787604296.211135:0:24695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a009ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ee4faca9-8d42-4529-92e3-bb37c4189833+10:2391:x1874438299756416:12345-192.168.203.16@tcp:4:dd.0 00010000:00010000:2.0:1787604296.211162:0:24695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037ddf089/0x6c241a9cc41dda51 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604296.211172:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604296.211186:0:24695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787604296.211193:0:24695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037ddf089/0x6c241a9cc41dda51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604296.211205:0:24695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037ddf089/0x6c241a9cc41dda51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787604296.281489:0:9030:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901898 is committed 00002000:00010000:3.0:1787604296.284256:0:24694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:3.0:1787604296.284271:0:24694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:3.0:1787604296.284290:0:24694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d216add0/0x6c241a9cc41dda4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604296.284306:0:24694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d216add0/0x6c241a9cc41dda4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604296.284316:0:24694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d216add0/0x6c241a9cc41dda4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604296.284324:0:24694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a083e4bc00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:3.0:1787604296.284330:0:24694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d216add0/0x6c241a9cc41dda4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604296.284374:0:24694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d216add0/0x6c241a9cc41dda4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604296.284403:0:24694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d216add0/0x6c241a9cc41dda4a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604296.284410:0:24694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d216add0/0x6c241a9cc41dda4a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604296.286337:0:24694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a009ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ee4faca9-8d42-4529-92e3-bb37c4189833+15:2391:x1874438299756288:12345-192.168.203.16@tcp:4:dd.0 Request processed in 76300us (241013us total) trans 12884901898 rc 0/0 00000100:00100000:3.0:1787604296.286364:0:24694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 4 00000100:00100000:3.0:1787604296.286417:0:24694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6 00000100:00100000:3.0:1787604296.287336:0:24694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a009f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ee4faca9-8d42-4529-92e3-bb37c4189833+14:2390:x1874438299756544:12345-192.168.203.16@tcp:4:dd.0 00010000:00010000:3.0:1787604296.287409:0:24694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1aff314/0x6c241a9cc41dda58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604296.288171:0:24694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604296.288244:0:24694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604296.288255:0:24694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1aff314/0x6c241a9cc41dda58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604296.288277:0:24694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1aff314/0x6c241a9cc41dda58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787604296.337400:0:9030:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901900 is committed 00002000:00010000:3.0:1787604296.337608:0:23240:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:3.0:1787604296.337614:0:23240:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:3.0:1787604296.337632:0:23240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009db6a943/0x6c241a9cc41dda43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604296.337646:0:23240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009db6a943/0x6c241a9cc41dda43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604296.337656:0:23240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009db6a943/0x6c241a9cc41dda43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604296.337663:0:23240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a097bf0600 already unused, calling callback (ffffffffc175e230) 00010000:00010000:3.0:1787604296.337670:0:23240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009db6a943/0x6c241a9cc41dda43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604296.337679:0:23240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009db6a943/0x6c241a9cc41dda43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604296.337730:0:23240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009db6a943/0x6c241a9cc41dda43 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604296.337740:0:23240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009db6a943/0x6c241a9cc41dda43 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787604296.337863:0:23240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa09f89e0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+12:2390:x1874438299756160:12345-192.168.203.16@tcp:4:dd.0 Request processed in 128767us (298296us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1787604296.337894:0:23240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 3 00000100:00100000:3.0:1787604296.337941:0:23240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:3.0:1787604296.337955:0:23240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0a009c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+11:2390:x1874438299756672:12345-192.168.203.16@tcp:4:dd.0 00010000:00010000:3.0:1787604296.337995:0:23240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e4548e8/0x6c241a9cc41dda5f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604296.338009:0:23240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604296.338014:0:23240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787604296.338023:0:23240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e4548e8/0x6c241a9cc41dda5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787604296.338038:0:23240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e4548e8/0x6c241a9cc41dda5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604296.341281:0:24695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037ddf089/0x6c241a9cc41dda51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604296.341314:0:24695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037ddf089/0x6c241a9cc41dda51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604296.341323:0:24695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037ddf089/0x6c241a9cc41dda51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604296.341331:0:24695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0a083e4b200 already unused, calling callback (ffffffffc175e230) 00010000:00010000:1.0:1787604296.341337:0:24695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037ddf089/0x6c241a9cc41dda51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604296.341346:0:24695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037ddf089/0x6c241a9cc41dda51 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604296.341381:0:24695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037ddf089/0x6c241a9cc41dda51 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787604296.341422:0:24695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037ddf089/0x6c241a9cc41dda51 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787604296.341547:0:24695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a009ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ee4faca9-8d42-4529-92e3-bb37c4189833+11:2391:x1874438299756416:12345-192.168.203.16@tcp:4:dd.0 Request processed in 130406us (295888us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1787604296.341558:0:24695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5 00000001:00080000:0.0:1787604296.387110:0:9030:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901901 is committed 00002000:00010000:2.0:1787604296.387247:0:24694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:2.0:1787604296.387254:0:24694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:2.0:1787604296.387272:0:24694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1aff314/0x6c241a9cc41dda58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604296.387287:0:24694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1aff314/0x6c241a9cc41dda58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604296.387298:0:24694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1aff314/0x6c241a9cc41dda58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604296.387307:0:24694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09f82072a00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:2.0:1787604296.387313:0:24694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1aff314/0x6c241a9cc41dda58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604296.387347:0:24694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1aff314/0x6c241a9cc41dda58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604296.387384:0:24694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1aff314/0x6c241a9cc41dda58 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787604296.387394:0:24694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1aff314/0x6c241a9cc41dda58 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787604296.387653:0:24694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a009f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ee4faca9-8d42-4529-92e3-bb37c4189833+9:2390:x1874438299756544:12345-192.168.203.16@tcp:4:dd.0 Request processed in 101217us (341970us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1787604296.387665:0:24694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6 00002000:00010000:0.0:1787604296.427999:0:23240:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1787604296.428032:0:23240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e4548e8/0x6c241a9cc41dda5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604296.428049:0:23240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e4548e8/0x6c241a9cc41dda5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604296.428058:0:23240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e4548e8/0x6c241a9cc41dda5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604296.428100:0:23240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa09f82073c00 already unused, calling callback (ffffffffc175e230) 00010000:00010000:0.0:1787604296.428107:0:23240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e4548e8/0x6c241a9cc41dda5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604296.428118:0:23240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e4548e8/0x6c241a9cc41dda5f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604296.428145:0:23240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e4548e8/0x6c241a9cc41dda5f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787604296.428155:0:23240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e4548e8/0x6c241a9cc41dda5f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787604296.428314:0:23240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0a009c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ee4faca9-8d42-4529-92e3-bb37c4189833+7:2390:x1874438299756672:12345-192.168.203.16@tcp:4:dd.0 Request processed in 90355us (382584us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1787604296.428327:0:23240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 7 00000001:00080000:2.0:1787604296.438113:0:9030:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901902 is committed 00000100:00100000:1.0:1787604296.694742:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcf96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3453:1874438316637312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787604296.694840:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604296.695029:0:3451:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787604296.695039:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316637440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787604296.695071:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604296.695709:0:23238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316637312 00000100:00100000:0.0:1787604296.695719:0:23238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316637312 00000100:00100000:0.0:1787604296.695768:0:23238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316637440 00000100:00100000:0.0:1787604296.695771:0:23238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316637440 00000100:00100000:0.0:1787604296.695806:0:23238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787604296.695816:0:23238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc453100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3453:x1874438316637312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787604296.695845:0:23238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71368704 pending 0 free 3859808256 avail 3849322496 00000100:00100000:0.0:1787604296.695902:0:23238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc453100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3453:x1874438316637312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604296.695920:0:23238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787604296.695937:0:23238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787604296.695942:0:23238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3451:x1874438316637440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787604296.695967:0:23238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787604296.695994:0:23238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3451:x1874438316637440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604296.695999:0:23238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1787604296.696014:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787604296.696029:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a087071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3452:1874438316637696:0@lo:400:kworker.0 00000100:00100000:0.0:1787604296.696061:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604296.696081:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a087072a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316638208:0@lo:400:kworker.0 00000100:00100000:0.0:1787604296.696104:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604296.696123:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a087070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3452:1874438316638720:0@lo:400:kworker.0 00000100:00100000:0.0:1787604296.696148:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604296.696172:0:3452:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787604296.696178:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a087071880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3452:1874438316637824:0@lo:400:kworker.0 00000100:00100000:0.0:1787604296.696200:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604296.696217:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a087070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3452:1874438316638336:0@lo:400:kworker.0 00000100:00100000:0.0:1787604296.696238:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604296.696254:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a087072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3452:1874438316638848:0@lo:400:kworker.0 00000100:00100000:0.0:1787604296.696276:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604296.696303:0:21926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316637696 00000100:00100000:0.0:1787604296.696307:0:21926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316637696 00000100:00100000:0.0:1787604296.696338:0:21926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787604296.696345:0:21926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a087072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3452:x1874438316637696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604296.696412:0:21926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a087072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3452:x1874438316637696:12345-0@lo:400:kworker.0 Request processed in 67us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604296.696419:0:21926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787604296.696441:0:23233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316638208 00000100:00100000:0.0:1787604296.696445:0:23233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316638208 00000100:00100000:0.0:1787604296.696478:0:23233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787604296.696485:0:23233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a087070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3452:x1874438316638208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604296.696517:0:23233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a087070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3452:x1874438316638208:12345-0@lo:400:kworker.0 Request processed in 32us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604296.696524:0:23233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787604296.696543:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316638720 00000100:00100000:0.0:1787604296.696547:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316638720 00000100:00100000:0.0:1787604296.696568:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316637824 00000100:00100000:0.0:1787604296.696571:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316637824 00000100:00100000:0.0:1787604296.696582:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316638336 00000100:00100000:0.0:1787604296.696585:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316638336 00000100:00100000:0.0:1787604296.696594:0:21920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316638848 00000100:00100000:0.0:1787604296.696596:0:21920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316638848 00000100:00100000:0.0:1787604296.696610:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787604296.696617:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a087071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3452:x1874438316638720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604296.696648:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a087071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3452:x1874438316638720:12345-0@lo:400:kworker.0 Request processed in 32us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604296.696654:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787604296.696667:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787604296.696672:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a087073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3452:x1874438316637824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604296.696729:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a087073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3452:x1874438316637824:12345-0@lo:400:kworker.0 Request processed in 57us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604296.696734:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787604296.696755:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787604296.696761:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a087071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3452:x1874438316638336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604296.696787:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a087071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3452:x1874438316638336:12345-0@lo:400:kworker.0 Request processed in 27us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604296.696793:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787604296.696804:0:21920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787604296.696810:0:21920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a087070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3452:x1874438316638848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604296.696833:0:21920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a087070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3452:x1874438316638848:12345-0@lo:400:kworker.0 Request processed in 23us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604296.696839:0:21920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787604296.696873:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a087072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316637952:0@lo:400:kworker.0 00000100:00100000:0.0:1787604296.696898:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604296.696918:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a087073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3450:1874438316638464:0@lo:400:kworker.0 00000100:00100000:0.0:1787604296.696954:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604296.696980:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787604296.696987:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a087071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3450:1874438316637568:0@lo:400:kworker.0 00000100:00100000:0.0:1787604296.697018:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604296.697028:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316638464 00000100:00100000:3.0:1787604296.697036:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316638464 00000100:00100000:0.0:1787604296.697057:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a087073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316638080:0@lo:400:kworker.0 00000100:00100000:3.0:1787604296.697079:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787604296.697088:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604296.697091:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b6194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3450:x1874438316638464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604296.697114:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a087070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3450:1874438316638592:0@lo:400:kworker.0 00000100:00100000:3.0:1787604296.697140:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b6194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3450:x1874438316638464:12345-0@lo:400:kworker.0 Request processed in 53us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787604296.697147:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787604296.697155:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787604296.697161:0:21922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316638592 00000100:00100000:3.0:1787604296.697167:0:21922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316638592 00000100:00100000:0.0:1787604296.697196:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a087073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3450:1874438316638464:0@lo:400:kworker.0 00000100:00100000:3.0:1787604296.697197:0:21922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787604296.697208:0:21922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b6197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3450:x1874438316638592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787604296.697236:0:22565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316637952 00000100:00100000:0.0:1787604296.697241:0:22565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316637952 00000100:00080000:2.0:1787604296.697256:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787604296.697262:0:21922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b6197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3450:x1874438316638592:12345-0@lo:400:kworker.0 Request processed in 56us (109us total) trans 0 rc 0/0 00000100:00080000:2.0:1787604296.697262:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787604296.697265:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787604296.697268:0:21922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787604296.697275:0:22565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787604296.697291:0:22565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a087073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316637952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787604296.697306:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a087071880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3452:1874438316637824:0@lo:400:kworker.0 00000100:00100000:2.0:1787604296.697314:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3451:1874438316637440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787604296.697320:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a087070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3452:1874438316638336:0@lo:400:kworker.0 00000100:00100000:0.0:1787604296.697336:0:22565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a087073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316637952:12345-0@lo:400:kworker.0 Request processed in 46us (435us total) trans 0 rc 0/0 00010000:00080000:3.0:1787604296.697338:0:3452:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0a087072680 x1874438316638848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604296.697356:0:22565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787604296.697359:0:3453:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:2.0:1787604296.697366:0:3453:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0a0b6f6df80, transno 12884901892 00000100:00100000:3.0:1787604296.697367:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a087072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3452:1874438316638848:0@lo:400:kworker.0 00000100:00100000:3.0:1787604296.697382:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a087071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3452:1874438316637696:0@lo:400:kworker.0 00000004:00080000:2.0:1787604296.697382:0:3453:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:0.0:1787604296.697388:0:23736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316638080 00000100:00100000:0.0:1787604296.697394:0:23736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316638080 00000100:00100000:3.0:1787604296.697395:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a087072a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316638208:0@lo:400:kworker.0 00000100:00100000:3.0:1787604296.697408:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a087070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3452:1874438316638720:0@lo:400:kworker.0 00000100:00100000:2.0:1787604296.697408:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcf96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3453:1874438316637312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787604296.697441:0:23736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787604296.697449:0:23736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b6195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316638080:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787604296.697470:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787604296.697490:0:23736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b6195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316638080:12345-0@lo:400:kworker.0 Request processed in 41us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604296.697498:0:23736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787604296.697728:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a087073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316638080:0@lo:400:kworker.0 00010000:00080000:0.0:1787604296.697744:0:3450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0a087070a80 x1874438316638592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787604312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787604296.697754:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a087070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3450:1874438316638592:0@lo:400:kworker.0 00000100:00100000:0.0:1787604296.697766:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a087072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316637952:0@lo:400:kworker.0 00000100:00100000:1.0:1787604296.698118:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316637568 00000100:00100000:1.0:1787604296.698123:0:21913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316637568 00000100:00100000:1.0:1787604296.698158:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787604296.698166:0:21913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a08af2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:3450:x1874438316637568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787604296.698208:0:21913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a08af2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57b6d7db-5b8e-4468-b46a-6c89167d0f60+24:3450:x1874438316637568:12345-0@lo:400:kworker.0 Request processed in 43us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604296.698215:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787604296.698451:0:3451:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787604296.698465:0:3451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bc451180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316638976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787604296.698501:0:3451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604296.698533:0:23238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316638976 00000100:00100000:1.0:1787604296.698536:0:23238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316638976 00000100:00100000:1.0:1787604296.698575:0:23238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787604296.698583:0:23238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bc451880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316638976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787604296.698598:0:23238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71368704 pending 0 free 3859808256 avail 3849322496 00000100:00100000:1.0:1787604296.698637:0:23238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bc451880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3451:x1874438316638976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604296.698653:0:23238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787604296.698719:0:3451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bc451180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3451:1874438316638976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787604296.699936:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a087071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57b6d7db-5b8e-4468-b46a-6c89167d0f60:3450:1874438316637568:0@lo:400:kworker.0 00010000:00010000:2.0:1787604297.141915:0:21908:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787604298.134878:0:24735:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1787604298.165869:0:21909:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604298.743709:0:3450:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787604298.743739:0:3450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0bcf96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316639104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787604298.743837:0:3450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787604298.744279:0:23238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316639104 00000100:00100000:1.0:1787604298.744291:0:23238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316639104 00000100:00100000:1.0:1787604298.744386:0:23238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787604298.744414:0:23238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316639104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787604298.744464:0:23238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787604298.744535:0:23238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3450:x1874438316639104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787604298.744543:0:23238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1787604298.744861:0:21916:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787604298.744966:0:3450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0bcf96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3450:1874438316639104:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787604299.193119:0:22982:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787604299.254819:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787604299.254850:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3453:1874438316639232:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787604299.254947:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787604299.255025:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316639232 00000100:00100000:2.0:1787604299.255035:0:21925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316639232 00000100:00100000:2.0:1787604299.255111:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787604299.255121:0:21925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0b7792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3453:x1874438316639232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787604299.255173:0:21925:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787604299.255233:0:21925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0b7792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3453:x1874438316639232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787604299.255242:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787604299.255309:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3453:1874438316639232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787604299.268538:0:3452:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787604299.268568:0:3452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0a0b7273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316639360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787604299.268673:0:3452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787604299.268840:0:21926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874438316639360 00000100:00100000:0.0:1787604299.268852:0:21926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874438316639360 00000100:00100000:0.0:1787604299.268919:0:21926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787604299.268930:0:21926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0a0bcf96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3452:x1874438316639360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787604299.268982:0:21926:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787604299.269045:0:21926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0a0bcf96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3452:x1874438316639360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787604299.269072:0:21926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787604299.269130:0:3452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0a0b7273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3452:1874438316639360:0@lo:41:osp-pre-0-1.0 Debug log: 14507 lines, 14507 kept, 0 dropped, 0 bad.