00010000:00010000:1.0F:1788463634.051955:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0F:1788463634.311489:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788463634.311518:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961781de4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485880448:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788463634.311606:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463634.311660:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485880448 00000100:00100000:2.0:1788463634.311668:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485880448 00000100:00100000:2.0:1788463634.311781:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788463634.311791:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485880448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788463634.311825:0:17061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788463634.311874:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485880448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463634.311880:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788463634.311932:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961781de4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485880448:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463634.312990:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788463634.313004:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485880576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463634.313061:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0F:1788463634.313274:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485880576 00000100:00100000:0.0:1788463634.313286:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485880576 00000100:00100000:0.0:1788463634.313329:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788463634.313338:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485880576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788463634.313365:0:18953:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788463634.313421:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485880576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463634.313427:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788463634.313505:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485880576:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788463634.376933:0:17809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788463635.076730:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788463635.333805:0:18558:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0a56831b-aebb-4a8f-ae8e-45964e8f9ab4 00000020:00000080:1.0:1788463635.333816:0:18558:0:(genops.c:885:class_export_put()) final put ffff961781703800/0a56831b-aebb-4a8f-ae8e-45964e8f9ab4 00000001:00080000:1.0:1788463635.334457:0:18558:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:1.0:1788463635.334470:0:18558:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000020:00000080:2.0:1788463635.341223:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff961781703800/0a56831b-aebb-4a8f-ae8e-45964e8f9ab4 for lustre-OST0000 00000020:00000080:2.0:1788463635.341278:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961781701800 for lustre-OST0000 00000001:00080000:3.0F:1788463635.343405:0:17036:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:3.0:1788463635.343462:0:17036:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96188689ae40 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:3.0:1788463635.343468:0:17036:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9618ad5f5800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9618b43bb9c0 00000020:00080000:3.0:1788463635.343472:0:17036:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9618ad5f5500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9618ad6cee00 00010000:00010000:2.0:1788463635.343614:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b0b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463635.343631:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b0b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463635.343639:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b0b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463635.343646:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463635.343651:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b0b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463635.343660:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b0b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463635.343714:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff961890145100) 00010000:00010000:2.0:1788463635.343717:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463635.343723:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b0b7 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463635.343730:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b0b7 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788463635.345359:0:17096:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00000020:00080000:1.0:1788463635.345460:0:17096:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788463636.102536:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463637.125542:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463637.935627:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463637.935795:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466918016 00000100:00100000:1.0:1788463637.935811:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466918016 00000100:00100000:1.0:1788463637.935937:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 74 00000100:00100000:1.0:1788463637.935952:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+12:15587:x1875339466918016:12345-192.168.204.53@tcp:60:lhsmtool_posix.0 00000100:00080000:2.0:1788463637.935969:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463637.936087:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+12:15587:x1875339466918016:12345-192.168.204.53@tcp:60:lhsmtool_posix.0 Request processed in 138us (2300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463637.936096:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 74 00000100:00100000:3.0:1788463637.957745:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463637.957987:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466918144 00000100:00100000:0.0:1788463637.958002:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466918144 00000100:00100000:0.0:1788463637.958103:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 75 00000100:00100000:0.0:1788463637.958117:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+5:15587:x1875339466918144:12345-192.168.204.53@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788463637.958266:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+5:15587:x1875339466918144:12345-192.168.204.53@tcp:60:lhsmtool_posix.0 Request processed in 151us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463637.958275:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 75 00000100:00080000:2.0:1788463637.958600:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788463637.961114:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463637.961220:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466918400 00000100:00100000:3.0:1788463637.961233:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466918400 00000100:00100000:3.0:1788463637.961305:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 16 00000100:00100000:3.0:1788463637.961329:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878c5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b4f176-a68a-42e0-807e-b5954986c863+12:15587:x1875339466918400:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788463637.968006:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878c5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b4f176-a68a-42e0-807e-b5954986c863+13:15587:x1875339466918400:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 Request processed in 6673us (6889us total) trans 8589934636 rc 0/0 00000100:00100000:2.0:1788463637.968026:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 16 00010000:00010000:1.0:1788463638.147994:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463638.256269:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463638.256346:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463638.256383:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463638.256832:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466918656 00000100:00100000:2.0:1788463638.256847:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466918656 00000100:00100000:2.0:1788463638.256946:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 33 00000100:00100000:2.0:1788463638.256960:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b4f176-a68a-42e0-807e-b5954986c863+6:2400:x1875339466918656:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463638.257060:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b4f176-a68a-42e0-807e-b5954986c863+6:2400:x1875339466918656:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 103us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463638.257068:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 33 00000100:00080000:3.0:1788463638.257237:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463638.257570:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466918912 00000100:00100000:0.0:1788463638.257621:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466918912 00000100:00100000:0.0:1788463638.257679:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 83 00000100:00100000:0.0:1788463638.257688:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2400:x1875339466918912:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463638.257733:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2400:x1875339466918912:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 46us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463638.257741:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 83 00000100:00080000:3.0:1788463638.257937:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788463638.258253:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466918528 00000100:00100000:3.0:1788463638.258259:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466918528 00000100:00100000:3.0:1788463638.258320:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 171 00000100:00100000:3.0:1788463638.258329:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c701ce0f-5243-483e-b03d-f799276c6ff2+13:2400:x1875339466918528:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463638.258375:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c701ce0f-5243-483e-b03d-f799276c6ff2+13:2400:x1875339466918528:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 47us (1991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463638.258382:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 171 00000100:00100000:1.0:1788463638.263900:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463638.266422:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466918784 00000100:00100000:0.0:1788463638.266441:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466918784 00000100:00100000:0.0:1788463638.266828:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 84 00000100:00100000:0.0:1788463638.266842:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:2400:x1875339466918784:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463638.267027:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:2400:x1875339466918784:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 189us (3143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463638.267037:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 84 00000100:00080000:3.0:1788463638.268208:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1788463638.411106:0:19378:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0a56831b-aebb-4a8f-ae8e-45964e8f9ab4 00000020:00000080:1.0:1788463638.411121:0:19378:0:(genops.c:885:class_export_put()) final put ffff961781700000/0a56831b-aebb-4a8f-ae8e-45964e8f9ab4 00000020:00000080:0.0:1788463638.417193:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff961781700000/0a56831b-aebb-4a8f-ae8e-45964e8f9ab4 for lustre-OST0001 00000020:00000080:0.0:1788463638.417293:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961781702000 for lustre-OST0001 00000001:00100000:1.0:1788463638.417449:0:19378:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 11b4f176-a68a-42e0-807e-b5954986c863 00000020:00000080:1.0:1788463638.417476:0:19378:0:(genops.c:885:class_export_put()) final put ffff961785e73000/11b4f176-a68a-42e0-807e-b5954986c863 00000020:00000080:3.0:1788463638.417626:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff961785e73000/11b4f176-a68a-42e0-807e-b5954986c863 for lustre-OST0001 00000020:00000080:3.0:1788463638.417652:0:1365:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961781702800 for lustre-OST0001 00000100:00100000:1.0:1788463638.915856:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485880704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788463638.915945:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961781de4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485880832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463638.915966:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463638.916150:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485880704 00000100:00100000:0.0:1788463638.916162:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485880704 00000100:00100000:0.0:1788463638.916251:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788463638.916269:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485880704:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463638.916326:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485881088:0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788463638.916542:0:18565:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788463638.918778:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463638.918887:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485881344:0@lo:400:kworker.0 00000100:00100000:2.0:1788463638.918954:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463638.919075:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485881856:0@lo:400:kworker.0 00000100:00100000:2.0:1788463638.919122:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463638.919169:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485882368:0@lo:400:kworker.0 00000100:00100000:3.0:1788463638.919186:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463638.919227:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463638.919236:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485881600:0@lo:400:kworker.0 00000100:00100000:2.0:1788463638.919264:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788463638.919276:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485880960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463638.919294:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463638.919334:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463638.919438:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485881472:0@lo:400:kworker.0 00000100:00100000:2.0:1788463638.919694:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463638.919722:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf556a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485881984:0@lo:400:kworker.0 00000100:00100000:2.0:1788463638.919749:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463638.919767:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485882496:0@lo:400:kworker.0 00000100:00100000:2.0:1788463638.919787:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463638.919833:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485881344 00000100:00100000:2.0:1788463638.919843:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485881344 00000100:00100000:2.0:1788463638.919903:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485881856 00000100:00100000:2.0:1788463638.919907:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485881856 00000100:00100000:2.0:1788463638.919925:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788463638.919935:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485881344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463638.920082:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485881344:12345-0@lo:400:kworker.0 Request processed in 148us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463638.920090:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788463638.920109:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788463638.920116:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485881856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463638.920144:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485881856:12345-0@lo:400:kworker.0 Request processed in 29us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463638.920149:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788463638.920183:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485881600 00000100:00100000:2.0:1788463638.920187:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485881600 00000100:00100000:2.0:1788463638.920222:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485881472 00000100:00100000:2.0:1788463638.920226:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485881472 00000100:00100000:2.0:1788463638.920241:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485881984 00000100:00100000:2.0:1788463638.920243:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485881984 00000100:00100000:2.0:1788463638.920258:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788463638.920264:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf554a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485881600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463638.920308:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf554a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485881600:12345-0@lo:400:kworker.0 Request processed in 33us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463638.920315:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788463638.920328:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788463638.920333:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485881472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463638.920457:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485881472:12345-0@lo:400:kworker.0 Request processed in 124us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463638.920695:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788463638.920709:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788463638.920716:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485881984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463638.920747:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485881984:12345-0@lo:400:kworker.0 Request processed in 32us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463638.920753:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788463638.920781:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485882368 00000100:00100000:2.0:1788463638.920784:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485882368 00000100:00100000:2.0:1788463638.920821:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485882496 00000100:00100000:2.0:1788463638.920825:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485882496 00000100:00100000:2.0:1788463638.920848:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788463638.920854:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485882368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463638.920887:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485882368:12345-0@lo:400:kworker.0 Request processed in 33us (1662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463638.920899:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788463638.920911:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788463638.920917:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485882496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463638.920949:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485882496:12345-0@lo:400:kworker.0 Request processed in 32us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463638.920954:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788463638.921192:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:2.0:1788463638.921199:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff961786b47100, transno 8589934596 00000004:00080000:2.0:1788463638.921218:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1788463638.921245:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485881472:0@lo:400:kworker.0 00000100:00100000:2.0:1788463638.921260:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf556a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485881984:0@lo:400:kworker.0 00010000:00080000:2.0:1788463638.921275:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618bf555500 x1875339485882496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463638.921285:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf555500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485882496:0@lo:400:kworker.0 00000100:00100000:2.0:1788463638.921432:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485881344:0@lo:400:kworker.0 00000100:00100000:2.0:1788463638.921448:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485881856:0@lo:400:kworker.0 00000100:00100000:2.0:1788463638.921687:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485882368:0@lo:400:kworker.0 00000100:00100000:2.0:1788463638.921934:0:18566:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788463638.921945:0:18566:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00080000:2.0:1788463638.921962:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788463638.921968:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788463638.921971:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788463638.921974:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463638.922194:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485880832 00000100:00100000:2.0:1788463638.922210:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485880832 00000100:00100000:2.0:1788463638.922239:0:18566:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788463638.922245:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485881088 00000100:00100000:2.0:1788463638.922248:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485881088 00000100:00100000:2.0:1788463638.922256:0:18566:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788463638.922261:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485880960 00000100:00100000:2.0:1788463638.922264:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485880960 00000100:00100000:2.0:1788463638.922457:0:20398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788463638.922468:0:20398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485880832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463638.922498:0:20398:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788463638.922570:0:20398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485880832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (3804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463638.922621:0:20398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788463638.922667:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961781de4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485880832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463638.922700:0:20398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788463638.922706:0:20398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf557b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485881088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788463638.922716:0:20398:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788463638.922745:0:20398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf557b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485881088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (3574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463638.922751:0:20398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788463638.922761:0:20398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788463638.922767:0:20398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485880960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788463638.922777:0:20398:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788463638.922820:0:20398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485880960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (3476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463638.922826:0:20398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788463638.922853:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485880960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463638.923614:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485881216:0@lo:400:kworker.0 00000100:00100000:1.0:1788463638.923672:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463638.923719:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485881728:0@lo:400:kworker.0 00000100:00100000:1.0:1788463638.923750:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463638.923770:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf556d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485882240:0@lo:400:kworker.0 00000100:00100000:1.0:1788463638.923792:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463638.923809:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485882752:0@lo:400:kworker.0 00000100:00100000:1.0:1788463638.923830:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463638.923875:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485881216 00000100:00100000:1.0:1788463638.923882:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485881216 00000100:00100000:1.0:1788463638.923930:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788463638.923939:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+24:3651:x1875339485881216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463638.923981:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+24:3651:x1875339485881216:12345-0@lo:400:kworker.0 Request processed in 43us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463638.923989:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788463638.924033:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485881216:0@lo:400:kworker.0 00000100:00100000:3.0:1788463638.927219:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485881600:0@lo:400:kworker.0 00000100:00100000:3.0:1788463638.927237:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485882112:0@lo:400:kworker.0 00000100:00100000:3.0:1788463638.927310:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463638.927359:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485882624:0@lo:400:kworker.0 00000100:00100000:3.0:1788463638.927385:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463638.927421:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485881728 00000100:00100000:3.0:1788463638.927428:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485881728 00000100:00100000:3.0:1788463638.927471:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485882240 00000100:00100000:3.0:1788463638.927474:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485882240 00000100:00100000:3.0:1788463638.927487:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485882752 00000100:00100000:3.0:1788463638.927489:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485882752 00000100:00100000:3.0:1788463638.927511:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485882624 00000100:00100000:3.0:1788463638.927513:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485882624 00000100:00100000:3.0:1788463638.927528:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788463638.927537:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485881728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463638.927611:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485881728:12345-0@lo:400:kworker.0 Request processed in 74us (3860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463638.927620:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788463638.927640:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788463638.927645:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485882240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463638.927675:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485882240:12345-0@lo:400:kworker.0 Request processed in 29us (3882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463638.927682:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788463638.927694:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788463638.927774:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485882112 00000100:00100000:1.0:1788463638.927779:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485882112 00000100:00100000:2.0:1788463638.927790:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788463638.927817:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485882624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463638.927826:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788463638.927840:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf555c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1875339485882112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463638.927924:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485882624:12345-0@lo:400:kworker.0 Request processed in 118us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463638.927926:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf555c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1875339485882112:12345-0@lo:400:kworker.0 Request processed in 87us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463638.927947:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788463638.927966:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788463638.928016:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788463638.928021:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788463638.928053:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485881728:0@lo:400:kworker.0 00000100:00100000:1.0:1788463638.928065:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf556d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485882240:0@lo:400:kworker.0 00000100:00100000:2.0:1788463638.928175:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485882624:0@lo:400:kworker.0 00000100:00100000:2.0:1788463638.928224:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485881088:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788463638.928236:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf557480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485882112:0@lo:400:kworker.0 00000100:00100000:0.0:1788463638.929453:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485880704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 13182us (13479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463638.929469:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788463638.929650:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485880704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463638.934942:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485882752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463638.935097:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485882752:12345-0@lo:400:kworker.0 Request processed in 7383us (11252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463638.935125:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:1.0:1788463638.935500:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618bf557800 x1875339485882752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463638.935516:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485882752:0@lo:400:kworker.0 00010000:00010000:2.0:1788463639.175186:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463639.427943:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961781de4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485882880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788463639.428019:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463639.428126:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485882880 00000100:00100000:2.0:1788463639.428135:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485882880 00000100:00100000:2.0:1788463639.428197:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788463639.428207:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485882880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788463639.428247:0:17062:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788463639.428324:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485882880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463639.428331:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788463639.428457:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961781de4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485882880:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788463639.429036:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463639.429047:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485883008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788463639.429084:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463639.429162:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485883008 00000100:00100000:0.0:1788463639.429168:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485883008 00000100:00100000:0.0:1788463639.429212:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788463639.429221:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485883008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788463639.429241:0:17061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788463639.429279:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485883008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463639.429297:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788463639.429632:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485883008:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788463639.811875:0:17093:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788463639.811885:0:17093:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788463639.811904:0:17093:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788463639.811914:0:17093:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788463640.203020:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463641.220181:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788463641.481271:0:17036:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00080000:0.0:1788463641.481285:0:17036:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:1.0:1788463641.481355:0:17096:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:1.0:1788463641.481368:0:17096:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00010000:00010000:1.0:1788463642.243803:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788463642.886889:0:20435:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 15:27:21 (1788463641) 00010000:00010000:0.0:1788463643.267902:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463643.385400:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463643.385447:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463643.385481:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463643.385519:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463643.385543:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463643.385566:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463643.385713:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466919168 00000100:00100000:3.0:1788463643.385723:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466919168 00000100:00100000:3.0:1788463643.385789:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466919680 00000100:00100000:3.0:1788463643.385792:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466919680 00000100:00100000:3.0:1788463643.385805:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466919296 00000100:00100000:3.0:1788463643.385808:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466919296 00000100:00100000:3.0:1788463643.385821:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466919552 00000100:00100000:3.0:1788463643.385824:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466919552 00000100:00100000:3.0:1788463643.385839:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 91 00000100:00100000:3.0:1788463643.385849:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b4f176-a68a-42e0-807e-b5954986c863+12:2402:x1875339466919168:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463643.385962:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466919424 00000100:00100000:1.0:1788463643.385967:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466919424 00000100:00100000:1.0:1788463643.385999:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 38 00000100:00100000:1.0:1788463643.386007:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b4f176-a68a-42e0-807e-b5954986c863+6:2402:x1875339466919424:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463643.386187:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b4f176-a68a-42e0-807e-b5954986c863+12:2402:x1875339466919168:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 336us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463643.386196:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 91 00000100:00100000:3.0:1788463643.386228:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 92 00000100:00100000:3.0:1788463643.386237:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2402:x1875339466919680:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463643.386278:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2402:x1875339466919680:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 43us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463643.386286:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 92 00000100:00100000:3.0:1788463643.386299:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 93 00000100:00100000:3.0:1788463643.386305:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b4f176-a68a-42e0-807e-b5954986c863+5:2402:x1875339466919296:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463643.386328:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b4f176-a68a-42e0-807e-b5954986c863+5:2402:x1875339466919296:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 22us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463643.386334:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 93 00000100:00100000:3.0:1788463643.386346:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 94 00000100:00100000:3.0:1788463643.386353:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:2402:x1875339466919552:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463643.386376:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:2402:x1875339466919552:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 24us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463643.386382:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 94 00000100:00080000:3.0:1788463643.386403:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788463643.386409:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788463643.386411:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463643.386599:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b4f176-a68a-42e0-807e-b5954986c863+6:2402:x1875339466919424:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 592us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463643.386619:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 38 00000100:00100000:3.0:1788463643.391680:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466919040 00000100:00100000:3.0:1788463643.391696:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466919040 00000100:00100000:3.0:1788463643.391937:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 173 00000100:00100000:3.0:1788463643.391949:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+13:2402:x1875339466919040:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463643.392026:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+13:2402:x1875339466919040:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 79us (6506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463643.392034:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 173 00000100:00100000:1.0:1788463644.037271:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961781de6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485883136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463644.037342:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463644.037396:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788463644.037402:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485883264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788463644.037440:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463644.037494:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485883392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463644.037542:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463644.037565:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463644.037571:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf5c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485883520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463644.037614:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463644.037647:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485883136 00000100:00100000:1.0:1788463644.037655:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485883136 00000100:00100000:1.0:1788463644.037702:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485883264 00000100:00100000:1.0:1788463644.037706:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485883264 00000100:00100000:1.0:1788463644.037718:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485883392 00000100:00100000:1.0:1788463644.037721:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485883392 00000100:00100000:1.0:1788463644.037734:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485883520 00000100:00100000:1.0:1788463644.037736:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485883520 00000100:00100000:1.0:1788463644.037750:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788463644.037758:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485883136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788463644.037804:0:18565:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788463644.037847:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485883136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463644.037864:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788463644.037883:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788463644.038325:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485883264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788463644.038344:0:18565:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788463644.038376:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485883264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 486us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463644.038382:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788463644.038398:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788463644.038412:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485883392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788463644.038423:0:18565:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788463644.038469:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485883392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463644.038475:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788463644.038488:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788463644.038494:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485883520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788463644.038503:0:18565:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788463644.038536:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485883520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463644.038543:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1788463644.038559:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788463644.038563:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788463644.038594:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485883264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788463644.038607:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961781de6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485883136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463644.038608:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf5c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485883520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463644.038626:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788463644.038632:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485883392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463644.038632:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485883648:0@lo:400:kworker.0 00000100:00100000:1.0:1788463644.038661:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463644.038732:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485883648 00000100:00100000:3.0:1788463644.038737:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485883648 00000100:00100000:3.0:1788463644.038766:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788463644.038773:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+24:3651:x1875339485883648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463644.038820:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+24:3651:x1875339485883648:12345-0@lo:400:kworker.0 Request processed in 48us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463644.038826:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788463644.042310:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485883648:0@lo:400:kworker.0 00000100:00100000:1.0:1788463644.049470:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463644.049493:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961898b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485883776:0@lo:400:kworker.0 00000100:00100000:1.0:1788463644.049558:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463644.049631:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485883776 00000100:00100000:1.0:1788463644.049640:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485883776 00000100:00100000:1.0:1788463644.049687:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788463644.049708:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485883776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463644.049761:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485883776:12345-0@lo:400:kworker.0 Request processed in 54us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463644.049768:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788463644.049812:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961898b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485883776:0@lo:400:kworker.0 00000100:00100000:1.0:1788463644.049874:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961898b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485883904:0@lo:400:kworker.0 00000100:00100000:1.0:1788463644.049903:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463644.049934:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485883904 00000100:00100000:1.0:1788463644.049938:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485883904 00000100:00100000:1.0:1788463644.049968:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788463644.049975:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485883904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463644.050009:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485883904:12345-0@lo:400:kworker.0 Request processed in 35us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463644.050016:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788463644.050046:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961898b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485883904:0@lo:400:kworker.0 00000100:00100000:1.0:1788463644.050077:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961898b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485884032:0@lo:400:kworker.0 00000100:00100000:1.0:1788463644.050100:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463644.050127:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485884032 00000100:00100000:1.0:1788463644.050132:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485884032 00000100:00100000:1.0:1788463644.050152:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788463644.050157:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485884032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463644.050187:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485884032:12345-0@lo:400:kworker.0 Request processed in 30us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463644.050193:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788463644.050229:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961898b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485884032:0@lo:400:kworker.0 00000100:00100000:1.0:1788463644.050271:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961898b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485884160:0@lo:400:kworker.0 00000100:00100000:1.0:1788463644.050294:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463644.050323:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485884160 00000100:00100000:1.0:1788463644.050327:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485884160 00000100:00100000:1.0:1788463644.050350:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788463644.050356:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485884160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463644.050389:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485884160:12345-0@lo:400:kworker.0 Request processed in 33us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463644.050395:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788463644.050421:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961898b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485884160:0@lo:400:kworker.0 00000100:00100000:1.0:1788463644.050448:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463644.050453:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961898b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485884288:0@lo:400:kworker.0 00000100:00100000:1.0:1788463644.050474:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463644.050495:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485884288 00000100:00100000:1.0:1788463644.050498:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485884288 00000100:00100000:1.0:1788463644.050529:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788463644.050534:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485884288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463644.050598:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485884288:12345-0@lo:400:kworker.0 Request processed in 62us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463644.050604:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1788463644.050622:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463644.050639:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961898b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485884288:0@lo:400:kworker.0 00000100:00100000:1.0:1788463644.050669:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961898b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485884416:0@lo:400:kworker.0 00000100:00100000:1.0:1788463644.050690:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463644.050712:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485884416 00000100:00100000:1.0:1788463644.050721:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485884416 00000100:00100000:1.0:1788463644.050746:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788463644.050752:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485884416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463644.050783:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485884416:12345-0@lo:400:kworker.0 Request processed in 31us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463644.050788:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1788463644.050803:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788463644.050821:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961898b26300 x1875339485884416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463644.050833:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961898b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485884416:0@lo:400:kworker.0 00000100:00100000:1.0:1788463644.050864:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961898b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485884544:0@lo:400:kworker.0 00000100:00100000:1.0:1788463644.050886:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463644.050910:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485884544 00000100:00100000:1.0:1788463644.050913:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485884544 00000100:00100000:1.0:1788463644.050939:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788463644.050945:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485884544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463644.050975:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485884544:12345-0@lo:400:kworker.0 Request processed in 30us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463644.050981:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1788463644.050995:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463644.051010:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961898b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485884544:0@lo:400:kworker.0 00000100:00100000:1.0:1788463644.051042:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961898b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485884672:0@lo:400:kworker.0 00000100:00100000:1.0:1788463644.051063:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463644.051085:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485884672 00000100:00100000:1.0:1788463644.051089:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485884672 00000100:00100000:1.0:1788463644.051119:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788463644.051134:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485884672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463644.051173:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485884672:12345-0@lo:400:kworker.0 Request processed in 41us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463644.051179:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1788463644.051210:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788463644.051227:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961898b26300 x1875339485884672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463644.051236:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961898b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485884672:0@lo:400:kworker.0 00010000:00010000:2.0:1788463644.296942:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463644.549517:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463644.549545:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961781de7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485884800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463644.549653:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463644.549773:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485884800 00000100:00100000:2.0:1788463644.549783:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485884800 00000100:00100000:2.0:1788463644.549849:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788463644.549859:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485884800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788463644.549903:0:17061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788463644.549955:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485884800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463644.549963:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788463644.550182:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961781de7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485884800:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788463644.550529:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788463644.550542:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485884928:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463644.550609:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463644.550787:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485884928 00000100:00100000:0.0:1788463644.550794:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485884928 00000100:00100000:0.0:1788463644.550833:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788463644.550841:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485884928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788463644.550866:0:18953:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788463644.550918:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485884928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463644.550925:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788463644.551002:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485884928:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788463644.617112:0:17809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788463645.316040:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463646.340291:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463647.364812:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463648.388410:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463648.495418:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463648.495478:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463648.495520:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463648.495549:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463648.495637:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466920064 00000100:00100000:1.0:1788463648.495646:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463648.495668:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466920064 00000100:00100000:1.0:1788463648.495685:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463648.495727:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466920320 00000100:00100000:1.0:1788463648.495736:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466920320 00000100:00100000:3.0:1788463648.495757:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466919936 00000100:00100000:3.0:1788463648.495763:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466919936 00000100:00100000:1.0:1788463648.495794:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466920448 00000100:00100000:1.0:1788463648.495802:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466920448 00000100:00100000:3.0:1788463648.495811:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 101 00000100:00100000:3.0:1788463648.495829:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+5:2403:x1875339466920064:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463648.495839:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 102 00000100:00100000:1.0:1788463648.495853:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:2403:x1875339466920320:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463648.495960:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+5:2403:x1875339466920064:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 129us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463648.495961:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:2403:x1875339466920320:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 103us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463648.495990:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 101 00000100:00100000:0.0:1788463648.496069:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466919808 00000100:00100000:0.0:1788463648.496076:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466919808 00000100:00100000:0.0:1788463648.496133:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 175 00000100:00100000:0.0:1788463648.496143:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c701ce0f-5243-483e-b03d-f799276c6ff2+13:2403:x1875339466919808:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463648.496175:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c701ce0f-5243-483e-b03d-f799276c6ff2+13:2403:x1875339466919808:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 35us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463648.496183:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 175 00000100:00100000:1.0:1788463648.496273:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 102 00000100:00100000:1.0:1788463648.496292:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 103 00000100:00100000:1.0:1788463648.496300:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+12:2403:x1875339466919936:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463648.496328:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+12:2403:x1875339466919936:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 30us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463648.496335:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 103 00000100:00100000:1.0:1788463648.496347:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 104 00000100:00100000:1.0:1788463648.496353:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2403:x1875339466920448:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463648.496378:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2403:x1875339466920448:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 24us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463648.496384:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 104 00000100:00080000:1.0:1788463648.496403:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788463648.496408:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788463648.496429:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466920192 00000100:00100000:1.0:1788463648.496434:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466920192 00000100:00100000:1.0:1788463648.496471:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 39 00000100:00100000:1.0:1788463648.496477:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b4f176-a68a-42e0-807e-b5954986c863+6:2403:x1875339466920192:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463648.496504:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b4f176-a68a-42e0-807e-b5954986c863+6:2403:x1875339466920192:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 27us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463648.496511:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 39 00000100:00080000:1.0:1788463648.496526:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463648.503312:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463648.503378:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463648.503496:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463648.503544:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466920960 00000100:00100000:2.0:1788463648.503557:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466920960 00000100:00100000:2.0:1788463648.503696:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 35 00000100:00100000:2.0:1788463648.503710:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b4f176-a68a-42e0-807e-b5954986c863+6:2399:x1875339466920960:12345-192.168.204.53@tcp:9:umount.0 00000020:00000080:2.0:1788463648.503759:0:18562:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3ad6f 00000020:00010000:2.0:1788463648.503772:0:18562:0:(genops.c:1921:obd_stale_export_put()) Put export ffff961785e71800: total 0 00000100:00080000:2.0:1788463648.503779:0:18562:0:(import.c:65:import_set_state_nolock()) ffff961785e77800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788463648.503848:0:18562:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1788463648.504062:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b4f176-a68a-42e0-807e-b5954986c863+4:2399:x1875339466920960:12345-192.168.204.53@tcp:9:umount.0 Request processed in 354us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463648.504072:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 35 00000020:00010000:2.0:1788463648.504101:0:17045:0:(genops.c:1907:obd_stale_export_get()) Get export ffff961785e71800: total 0 00010000:00010000:2.0:1788463648.504135:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463648.504163:0:17045:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff961785e71800, canceled 0 locks, left on hash table 1. 00002000:00010000:2.0:1788463648.504711:0:17045:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788463648.504717:0:17045:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1788463628 -> 1788463630 00002000:00010000:2.0:1788463648.504721:0:17045:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788463628 -> 1788463630 00002000:00010000:2.0:1788463648.504724:0:17045:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788463648.504733:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466920576 00010000:00010000:2.0:1788463648.504765:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9b7a5d1/0x841acb7f42a3b0e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c7e expref: 3 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463648.504768:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466920576 00010000:00010000:2.0:1788463648.504811:0:17045:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff961785e71800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788463648.504836:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463648.504839:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463648.504841:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463648.504858:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466920704 00000100:00100000:1.0:1788463648.504864:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466920704 00000100:00100000:1.0:1788463648.504919:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 4 00000100:00100000:1.0:1788463648.504930:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c701ce0f-5243-483e-b03d-f799276c6ff2+14:2403:x1875339466920576:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463648.504949:0:17041:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463648.504975:0:17041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618c1e26e00/0x841acb7f42a3ad4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ab7 expref: 14 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463648.504996:0:17041:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463648.505065:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c701ce0f-5243-483e-b03d-f799276c6ff2+13:2403:x1875339466920576:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 137us (1780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463648.505074:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 4 00000100:00100000:1.0:1788463648.505098:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 5 00000100:00100000:1.0:1788463648.505105:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c701ce0f-5243-483e-b03d-f799276c6ff2+12:2403:x1875339466920704:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463648.505123:0:17041:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463648.505133:0:17041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961882813000/0x841acb7f42a3ad53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ae8 expref: 12 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463648.505146:0:17041:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463648.511616:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c701ce0f-5243-483e-b03d-f799276c6ff2+11:2403:x1875339466920704:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 6492us (8219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463648.511635:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 5 00000100:00100000:3.0:1788463648.528165:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463648.528456:0:20084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466921088 00000100:00100000:0.0:1788463648.528483:0:20084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466921088 00000100:00100000:0.0:1788463648.528632:0:20084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 6 00000100:00100000:0.0:1788463648.528644:0:20084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf554700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c701ce0f-5243-483e-b03d-f799276c6ff2+11:2400:x1875339466921088:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463648.528662:0:20084:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463648.528686:0:20084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3add8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b9e expref: 11 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463648.528708:0:20084:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463648.528805:0:20084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf554700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c701ce0f-5243-483e-b03d-f799276c6ff2+10:2400:x1875339466921088:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 163us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463648.528813:0:20084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 6 00000100:00100000:2.0:1788463648.533418:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463648.533523:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466921984 00000100:00100000:1.0:1788463648.533539:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466921984 00000100:00100000:1.0:1788463648.533671:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 76 00000100:00100000:1.0:1788463648.533682:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+12:2399:x1875339466921984:12345-192.168.204.53@tcp:39:umount.0 00000020:00000080:1.0:1788463648.533743:0:17057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3ad61 00000020:00010000:1.0:1788463648.533764:0:17057:0:(genops.c:1921:obd_stale_export_put()) Put export ffff961787328800: total 0 00000100:00080000:1.0:1788463648.533770:0:17057:0:(import.c:65:import_set_state_nolock()) ffff961787329000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788463648.533799:0:17057:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00100000:1.0:1788463648.533976:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+11:2399:x1875339466921984:12345-192.168.204.53@tcp:39:umount.0 Request processed in 295us (579us total) trans 8589934637 rc 0/0 00000100:00100000:1.0:1788463648.533984:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 76 00000020:00010000:3.0:1788463648.534560:0:17044:0:(genops.c:1907:obd_stale_export_get()) Get export ffff961787328800: total 0 00010000:00010000:3.0:1788463648.534646:0:17044:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff961787328800, canceled 0 locks, left on hash table 7. 00010000:00010000:3.0:1788463648.534690:0:17044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961884f9d300) 00010000:00010000:3.0:1788463648.534694:0:17044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463648.534702:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c200/0x841acb7f42a3ae48 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bac expref: 10 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463648.534876:0:17044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961885469800) 00010000:00010000:3.0:1788463648.534888:0:17044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788463648.534894:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3ae87 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bba expref: 9 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463648.534914:0:17044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff961890145100) 00010000:00010000:3.0:1788463648.534917:0:17044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788463648.534921:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b08d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c5b expref: 8 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463648.534937:0:17044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff961884f9da00) 00010000:00010000:3.0:1788463648.534940:0:17044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788463648.534944:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3ae2c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ba5 expref: 7 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463648.534958:0:17044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff961890145600) 00010000:00010000:3.0:1788463648.534960:0:17044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788463648.534964:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5400/0x841acb7f42a3af0c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476be4 expref: 6 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463648.534978:0:17044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:3.0:1788463648.534980:0:17044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788463648.534984:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4e00/0x841acb7f42a3b032 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c46 expref: 5 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463648.534995:0:17044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:3.0:1788463648.534997:0:17044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788463648.535000:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5600/0x841acb7f42a3b0ef lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c85 expref: 4 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463648.535026:0:17044:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff961787328800, canceled 7 locks, left on hash table 0. 00010000:00010000:3.0:1788463648.535051:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463648.535054:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463648.535056:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463648.544788:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463648.545344:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466922112 00000100:00100000:3.0:1788463648.545371:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466922112 00000100:00100000:3.0:1788463648.545615:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 77 00000100:00100000:3.0:1788463648.545628:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+5:2399:x1875339466922112:12345-192.168.204.53@tcp:39:umount.0 00000020:00000080:3.0:1788463648.545674:0:18932:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3ad68 00000100:00080000:3.0:1788463648.545697:0:18932:0:(import.c:65:import_set_state_nolock()) ffff96178732e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788463648.545727:0:18932:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:2.0:1788463648.545902:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463648.551439:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+3:2399:x1875339466922112:12345-192.168.204.53@tcp:39:umount.0 Request processed in 5789us (6642us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788463648.551560:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 77 00000040:00080000:3.0:1788463649.028997:0:17093:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788463649.029013:0:17093:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788463649.029039:0:17093:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788463649.029050:0:17093:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788463649.158646:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485885056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463649.158776:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463649.158893:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485885568:0@lo:400:kworker.0 00000100:00100000:2.0:1788463649.158894:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485885440:0@lo:400:kworker.0 00000100:00100000:3.0:1788463649.158952:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463649.158957:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463649.158969:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485885312:0@lo:400:kworker.0 00000100:00100000:1.0:1788463649.159011:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961898b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485885184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463649.160974:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485886080:0@lo:400:kworker.0 00000100:00100000:3.0:1788463649.161065:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463649.161136:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485886592:0@lo:400:kworker.0 00000100:00100000:3.0:1788463649.161195:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463649.161235:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485887104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463649.161264:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463649.161295:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463649.161303:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485886976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463649.161331:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463649.161404:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485885056 00000100:00100000:3.0:1788463649.161415:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485885056 00000100:00100000:3.0:1788463649.161487:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485887104 00000100:00100000:3.0:1788463649.161490:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485887104 00000100:00100000:3.0:1788463649.161507:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485886976 00000100:00100000:3.0:1788463649.161510:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485886976 00000100:00100000:3.0:1788463649.161534:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788463649.161544:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485885056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788463649.161738:0:18565:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788463649.161803:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485885056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 260us (3030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463649.161812:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788463649.161837:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788463649.161844:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf557800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485887104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788463649.161862:0:18565:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788463649.161893:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf557800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485887104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463649.161900:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788463649.161979:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485885952:0@lo:400:kworker.0 00000100:00100000:2.0:1788463649.162020:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463649.162055:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485886464:0@lo:400:kworker.0 00000100:00100000:2.0:1788463649.162080:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463649.162133:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485886592 00000100:00100000:2.0:1788463649.162138:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485886592 00000100:00100000:2.0:1788463649.162174:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485886464 00000100:00100000:2.0:1788463649.162177:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485886464 00000100:00100000:2.0:1788463649.162870:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788463649.162884:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485886592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463649.162965:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485886592:12345-0@lo:400:kworker.0 Request processed in 86us (1769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463649.162973:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788463649.162989:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788463649.162995:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf55e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485886464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463649.163029:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf55e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485886464:12345-0@lo:400:kworker.0 Request processed in 34us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463649.163036:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788463649.163091:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485886464:0@lo:400:kworker.0 00000100:00100000:1.0:1788463649.163364:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463649.163427:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485885696:0@lo:400:kworker.0 00000100:00100000:1.0:1788463649.163506:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463649.163543:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485886208:0@lo:400:kworker.0 00000100:00100000:1.0:1788463649.163570:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463649.163603:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf55ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485886720:0@lo:400:kworker.0 00000100:00100000:1.0:1788463649.163628:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463649.163699:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485885440 00000100:00100000:1.0:1788463649.164821:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485885440 00000100:00100000:1.0:1788463649.164882:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485885952 00000100:00100000:1.0:1788463649.164886:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485885952 00000100:00100000:1.0:1788463649.164905:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788463649.164914:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485885440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463649.164997:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485885440:12345-0@lo:400:kworker.0 Request processed in 83us (6042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463649.165006:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788463649.165024:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788463649.165031:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf55e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485885952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463649.165963:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf55e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485885952:12345-0@lo:400:kworker.0 Request processed in 927us (3937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463649.165972:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788463649.166012:0:20398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485885184 00000100:00100000:1.0:1788463649.166017:0:20398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485885184 00000100:00100000:0.0:1788463649.181110:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463649.181188:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485885824:0@lo:400:kworker.0 00000100:00100000:0.0:1788463649.181235:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463649.181258:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485886336:0@lo:400:kworker.0 00000100:00100000:0.0:1788463649.181293:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463649.181306:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485886848:0@lo:400:kworker.0 00000100:00100000:0.0:1788463649.181327:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463649.181361:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485886720 00000100:00100000:0.0:1788463649.181370:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485886720 00000100:00100000:0.0:1788463649.181413:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485885824 00000100:00100000:0.0:1788463649.181416:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485885824 00000100:00100000:0.0:1788463649.181429:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485886336 00000100:00100000:0.0:1788463649.181431:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485886336 00000100:00100000:0.0:1788463649.181440:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485886848 00000100:00100000:0.0:1788463649.181442:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485886848 00000100:00100000:0.0:1788463649.181457:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788463649.181465:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485886720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463649.187151:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485886720:12345-0@lo:400:kworker.0 Request processed in 5674us (23509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463649.187167:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788463649.187207:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788463649.187225:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485885824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463649.187863:0:20398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788463649.187877:0:20398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf557480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485886976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788463649.187899:0:20398:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788463649.187954:0:20398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf557480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485886976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (26623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463649.187961:0:20398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788463649.187979:0:20398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788463649.187985:0:20398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485885184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788463649.187996:0:20398:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788463649.188027:0:20398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485885184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (24676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463649.188033:0:20398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788463649.188064:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485885568 00000100:00100000:1.0:1788463649.188071:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485885568 00000100:00100000:1.0:1788463649.189298:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485886080 00000100:00100000:1.0:1788463649.189311:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485886080 00000100:00100000:1.0:1788463649.189343:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485885696 00000100:00100000:1.0:1788463649.189346:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485885696 00000100:00100000:1.0:1788463649.189358:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485886208 00000100:00100000:1.0:1788463649.189361:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485886208 00000100:00100000:1.0:1788463649.189375:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788463649.189384:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf555f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485885568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463649.189467:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf555f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485885568:12345-0@lo:400:kworker.0 Request processed in 84us (30517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463649.189591:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788463649.189611:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788463649.189617:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf555180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485886080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463649.189649:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf555180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485886080:12345-0@lo:400:kworker.0 Request processed in 32us (28584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463649.189655:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788463649.189664:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788463649.189670:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485885696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463649.189717:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485885696:12345-0@lo:400:kworker.0 Request processed in 48us (26212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463649.189723:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788463649.189734:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788463649.189820:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485886208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463649.189850:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485886208:12345-0@lo:400:kworker.0 Request processed in 35us (26280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463649.189856:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788463649.189930:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961898b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485885184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463649.189946:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485885696:0@lo:400:kworker.0 00000100:00100000:1.0:1788463649.189957:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485886208:0@lo:400:kworker.0 00000100:00100000:1.0:1788463649.189969:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf55ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485886720:0@lo:400:kworker.0 00000100:00100000:1.0:1788463649.190163:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788463649.190174:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485886336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463649.190441:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485885824:12345-0@lo:400:kworker.0 Request processed in 3223us (9202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463649.190457:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788463649.190467:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485886336:12345-0@lo:400:kworker.0 Request processed in 290us (9166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463649.190474:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788463649.190503:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485885824:0@lo:400:kworker.0 00000100:00100000:0.0:1788463649.190515:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485886336:0@lo:400:kworker.0 00000100:00100000:0.0:1788463649.190561:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788463649.190622:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485886848:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788463649.190638:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788463649.190656:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788463649.190661:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788463649.190663:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463649.190688:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485885440:0@lo:400:kworker.0 00000100:00100000:1.0:1788463649.191648:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485886976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463649.191675:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485887104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788463649.191690:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485885568:0@lo:400:kworker.0 00000100:00100000:1.0:1788463649.191701:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485886080:0@lo:400:kworker.0 00010000:00080000:1.0:1788463649.191719:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618c1b26a00 x1875339485886592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463649.191730:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485886592:0@lo:400:kworker.0 00000100:00100000:1.0:1788463649.191920:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485885056:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463649.191992:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485885312 00000100:00100000:1.0:1788463649.191999:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485885312 00000100:00100000:1.0:1788463649.192064:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788463649.192073:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+24:3651:x1875339485885312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463649.192161:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+24:3651:x1875339485885312:12345-0@lo:400:kworker.0 Request processed in 87us (11070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463649.192170:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788463649.192266:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485885312:0@lo:400:kworker.0 00000100:00100000:0.0:1788463649.196452:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485886848:12345-0@lo:400:kworker.0 Request processed in 5874us (15112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463649.196471:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:1.0:1788463649.197203:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618bf55d880 x1875339485886848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463649.197229:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485886848:0@lo:400:kworker.0 00000100:00100000:2.0:1788463649.200324:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485885952:0@lo:400:kworker.0 00010000:00010000:3.0:1788463649.412375:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463649.669924:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788463649.669959:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf55df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485887232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788463649.670102:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463649.670219:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485887232 00000100:00100000:2.0:1788463649.670231:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485887232 00000100:00100000:2.0:1788463649.670315:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788463649.670327:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485887232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788463649.670381:0:17062:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788463649.670445:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485887232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463649.670453:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788463649.670734:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485887360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788463649.670767:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463649.670826:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf55df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485887232:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788463649.671552:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485887360 00000100:00100000:2.0:1788463649.671560:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485887360 00000100:00100000:2.0:1788463649.671652:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788463649.671662:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485887360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788463649.671699:0:17061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788463649.671788:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485887360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463649.671795:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788463649.671992:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485887360:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788463650.437787:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463651.460180:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463652.177182:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463652.177231:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463652.177277:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463652.177610:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466922368 00000100:00100000:0.0:1788463652.177620:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466922368 00000100:00100000:0.0:1788463652.177699:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466922240 00000100:00100000:0.0:1788463652.177703:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466922240 00000100:00100000:0.0:1788463652.177718:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466922496 00000100:00100000:0.0:1788463652.177720:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466922496 00000100:00100000:0.0:1788463652.177736:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 7 00000100:00100000:0.0:1788463652.177746:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf55d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c701ce0f-5243-483e-b03d-f799276c6ff2+12:2401:x1875339466922368:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463652.177762:0:17042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463652.177783:0:17042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961787d0d800/0x841acb7f42a3ad92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b58 expref: 12 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463652.177799:0:17042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463652.177850:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf55d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c701ce0f-5243-483e-b03d-f799276c6ff2+11:2401:x1875339466922368:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 105us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463652.177873:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 7 00000100:00100000:0.0:1788463652.177891:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 8 00000100:00100000:0.0:1788463652.177897:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf55c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c701ce0f-5243-483e-b03d-f799276c6ff2+10:2401:x1875339466922240:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463652.177904:0:17042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463652.177912:0:17042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961882813800/0x841acb7f42a3ad8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b27 expref: 10 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463652.177922:0:17042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463652.177950:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf55c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c701ce0f-5243-483e-b03d-f799276c6ff2+9:2401:x1875339466922240:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 42us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463652.177957:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 8 00000100:00100000:0.0:1788463652.177970:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 9 00000100:00100000:0.0:1788463652.177977:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c701ce0f-5243-483e-b03d-f799276c6ff2+8:2401:x1875339466922496:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463652.177984:0:17042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463652.177993:0:17042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618c1e27a00/0x841acb7f42a3add1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b97 expref: 8 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463652.178002:0:17042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463652.178018:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf55ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c701ce0f-5243-483e-b03d-f799276c6ff2+7:2401:x1875339466922496:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 42us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463652.178025:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 9 00000100:00100000:0.0:1788463652.180919:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463652.181087:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466922752 00000100:00100000:1.0:1788463652.181099:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466922752 00000100:00100000:1.0:1788463652.181187:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 78 00000100:00100000:1.0:1788463652.181197:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:2399:x1875339466922752:12345-192.168.204.53@tcp:39:umount.0 00000020:00000080:1.0:1788463652.181246:0:17058:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3ada0 00000020:00010000:1.0:1788463652.181257:0:17058:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9618bf57b000: total 0 00000100:00080000:1.0:1788463652.181263:0:17058:0:(import.c:65:import_set_state_nolock()) ffff9618bf57e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788463652.181357:0:17058:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00100000:1.0:1788463652.181505:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2399:x1875339466922752:12345-192.168.204.53@tcp:39:umount.0 Request processed in 308us (595us total) trans 8589934638 rc 0/0 00000100:00100000:1.0:1788463652.181512:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 78 00000100:00080000:0.0:1788463652.183645:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1788463652.191569:0:17045:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9618bf57b000: total 0 00010000:00010000:3.0:1788463652.194820:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463652.194901:0:17045:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9618bf57b000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788463652.194943:0:17045:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961885469800) 00010000:00010000:3.0:1788463652.194948:0:17045:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788463652.194959:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3ae95 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bc1 expref: 4 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463652.194988:0:17045:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9618bf57b000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788463652.195000:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463652.195002:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463652.195005:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463652.197649:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463652.197782:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466922880 00000100:00100000:1.0:1788463652.197794:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466922880 00000100:00100000:1.0:1788463652.197864:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 79 00000100:00100000:1.0:1788463652.197875:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf55f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2399:x1875339466922880:12345-192.168.204.53@tcp:39:umount.0 00000020:00000080:1.0:1788463652.197921:0:18932:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3ada7 00000100:00080000:1.0:1788463652.197931:0:18932:0:(import.c:65:import_set_state_nolock()) ffff961781706000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788463652.197969:0:18932:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00080000:0.0:1788463652.198611:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788463652.198708:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463652.209880:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf55f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+3:2399:x1875339466922880:12345-192.168.204.53@tcp:39:umount.0 Request processed in 11694us (11927us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788463652.209895:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 79 00000100:00100000:1.0:1788463652.306438:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463652.309242:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466923136 00000100:00100000:0.0:1788463652.309269:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466923136 00000100:00100000:0.0:1788463652.309384:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 177 00000100:00100000:0.0:1788463652.309406:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+7:2399:x1875339466923136:12345-192.168.204.53@tcp:251:umount.0 00000020:00000080:0.0:1788463652.309464:0:17050:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3ad3e 00000020:00010000:0.0:1788463652.309473:0:17050:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9617885ba000: total 0 00000100:00080000:0.0:1788463652.309479:0:17050:0:(import.c:65:import_set_state_nolock()) ffff9617885bd000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788463652.309617:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+3:2399:x1875339466923136:12345-192.168.204.53@tcp:251:umount.0 Request processed in 214us (3190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463652.309625:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 177 00000020:00010000:2.0:1788463652.310004:0:17045:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9617885ba000: total 0 00010000:00010000:2.0:1788463652.310074:0:17045:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9617885ba000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788463652.310109:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961882813600/0x841acb7f42a3ad45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ab0 expref: 2 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463652.310128:0:17045:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9617885ba000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788463652.310139:0:17045:0:(genops.c:885:class_export_put()) final put ffff9617885ba000/c701ce0f-5243-483e-b03d-f799276c6ff2 00010000:00010000:2.0:1788463652.310153:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463652.310155:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463652.310157:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788463652.310167:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff9617885ba000/c701ce0f-5243-483e-b03d-f799276c6ff2 for MGS 00000020:00000080:2.0:1788463652.310199:0:1365:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9617885bd000 for MGS 00010000:00010000:3.0:1788463652.486098:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463653.518059:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463654.275915:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485887616:0@lo:400:kworker.0 00000100:00100000:2.0:1788463654.276035:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463654.276097:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf55fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485888128:0@lo:400:kworker.0 00000100:00100000:2.0:1788463654.276139:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463654.276158:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485888640:0@lo:400:kworker.0 00000100:00100000:2.0:1788463654.276181:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463654.276210:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788463654.276216:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf55ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61537c78-f571-4169-84d6-9d8a2058e62c:3649:1875339485887488:0@lo:400:kworker.0 00000100:00100000:2.0:1788463654.276257:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463654.276284:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf55f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485888000:0@lo:400:kworker.0 00000100:00100000:2.0:1788463654.276303:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463654.276317:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf55df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485888512:0@lo:400:kworker.0 00000100:00100000:2.0:1788463654.276337:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463654.276351:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485889024:0@lo:400:kworker.0 00000100:00100000:2.0:1788463654.276375:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463654.276400:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf55d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485887744:0@lo:400:kworker.0 00000100:00100000:2.0:1788463654.276431:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463654.276459:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf55ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485888256:0@lo:400:kworker.0 00000100:00100000:2.0:1788463654.276476:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463654.276490:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf55ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485888768:0@lo:400:kworker.0 00000100:00100000:2.0:1788463654.276511:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463654.276522:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788463654.276528:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf55c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485887872:0@lo:400:kworker.0 00000100:00100000:2.0:1788463654.276549:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463654.276564:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf55dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485888384:0@lo:400:kworker.0 00000100:00100000:2.0:1788463654.276621:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463654.276635:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485888896:0@lo:400:kworker.0 00000100:00100000:2.0:1788463654.276653:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463654.276685:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485887616 00000100:00100000:2.0:1788463654.276695:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485887616 00000100:00100000:2.0:1788463654.276748:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485888128 00000100:00100000:2.0:1788463654.276751:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485888128 00000100:00100000:2.0:1788463654.276766:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788463654.276783:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485887616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463654.276850:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485887616:12345-0@lo:400:kworker.0 Request processed in 68us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463654.276860:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788463654.276883:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788463654.276890:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485888128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463654.276915:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485888128:12345-0@lo:400:kworker.0 Request processed in 27us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463654.276921:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788463654.276944:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485888640 00000100:00100000:2.0:1788463654.276948:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485888640 00000100:00100000:2.0:1788463654.276981:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485888000 00000100:00100000:2.0:1788463654.276984:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485888000 00000100:00100000:2.0:1788463654.277009:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485888512 00000100:00100000:2.0:1788463654.277012:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485888512 00000100:00100000:2.0:1788463654.277029:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485889024 00000100:00100000:2.0:1788463654.277032:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485889024 00000100:00100000:2.0:1788463654.277045:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485888768 00000100:00100000:2.0:1788463654.277047:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485888768 00000100:00100000:2.0:1788463654.277076:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485888896 00000100:00100000:2.0:1788463654.277080:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485888896 00000100:00100000:2.0:1788463654.277092:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788463654.277098:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485888640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463654.277138:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485888640:12345-0@lo:400:kworker.0 Request processed in 39us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463654.277145:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000001:00100000:3.0:1788463654.277164:0:17789:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0a56831b-aebb-4a8f-ae8e-45964e8f9ab4 00000100:00100000:2.0:1788463654.277164:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788463654.277173:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485888000:12345-0@lo:400:kworker.0 00000001:00080000:3.0:1788463654.277185:0:17789:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:3.0:1788463654.277192:0:17789:0:(genops.c:885:class_export_put()) final put ffff961781703000/0a56831b-aebb-4a8f-ae8e-45964e8f9ab4 00000001:00100000:3.0:1788463654.277218:0:17789:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 11b4f176-a68a-42e0-807e-b5954986c863 00000100:00100000:2.0:1788463654.277218:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485888000:12345-0@lo:400:kworker.0 Request processed in 44us (911us total) trans 0 rc 0/0 00000001:00080000:3.0:1788463654.277236:0:17789:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000100:00100000:2.0:1788463654.277236:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000020:00000080:3.0:1788463654.277242:0:17789:0:(genops.c:885:class_export_put()) final put ffff96178732a000/11b4f176-a68a-42e0-807e-b5954986c863 00000100:00100000:2.0:1788463654.277256:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788463654.277265:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad76b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485888512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463654.277302:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad76b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485888512:12345-0@lo:400:kworker.0 Request processed in 39us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463654.277307:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788463654.277318:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788463654.277324:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad76bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485889024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463654.277353:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad76bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485889024:12345-0@lo:400:kworker.0 Request processed in 28us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463654.277360:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788463654.277373:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788463654.277399:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485888768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463654.277502:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485888768:12345-0@lo:400:kworker.0 Request processed in 110us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463654.277797:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485887744 00000100:00100000:1.0:1788463654.277804:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485887744 00000100:00100000:1.0:1788463654.277832:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485888256 00000100:00100000:1.0:1788463654.277835:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485888256 00000100:00100000:1.0:1788463654.277857:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485887872 00000100:00100000:1.0:1788463654.277861:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485887872 00000100:00100000:1.0:1788463654.277871:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485888384 00000100:00100000:1.0:1788463654.277874:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485888384 00000100:00100000:1.0:1788463654.278054:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788463654.278061:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485887744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463654.278107:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485887744:12345-0@lo:400:kworker.0 Request processed in 47us (1678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463654.278113:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788463654.278410:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788463654.278423:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad76a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485888896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463654.278460:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad76a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485888896:12345-0@lo:400:kworker.0 Request processed in 42us (1806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463654.278467:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:2.0:1788463654.278495:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788463654.278500:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788463654.278503:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788463654.278505:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463654.278550:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485888896:0@lo:400:kworker.0 00000100:00100000:2.0:1788463654.278570:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf55d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485887744:0@lo:400:kworker.0 00010000:00080000:2.0:1788463654.278613:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618bf55ce00 x1875339485888768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463654.278633:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf55ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485888768:0@lo:400:kworker.0 00000020:00000080:2.0:1788463654.278678:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff961781703000/0a56831b-aebb-4a8f-ae8e-45964e8f9ab4 for lustre-MDT0001 00000020:00000080:2.0:1788463654.278751:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96178732a000/11b4f176-a68a-42e0-807e-b5954986c863 for lustre-MDT0001 00000020:00000080:2.0:1788463654.278781:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961781706000 for lustre-MDT0001 00000020:00000080:2.0:1788463654.278785:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96178732e000 for lustre-MDT0001 00000100:00100000:3.0:1788463654.278821:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788463654.278922:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485887488 00000100:00100000:3.0:1788463654.278933:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485887488 00000100:00100000:1.0:1788463654.278948:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788463654.278962:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485888256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463654.278985:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788463654.279009:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+24:3649:x1875339485887488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463654.279181:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf55f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485888000:0@lo:400:kworker.0 00000001:00100000:0.0:1788463654.279538:0:18558:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 11b4f176-a68a-42e0-807e-b5954986c863 00000020:00000080:0.0:1788463654.279544:0:18558:0:(genops.c:885:class_export_put()) final put ffff961785e71800/11b4f176-a68a-42e0-807e-b5954986c863 00000020:00000080:0.0:1788463654.279570:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff961785e71800/11b4f176-a68a-42e0-807e-b5954986c863 for lustre-OST0000 00000020:00000080:0.0:1788463654.279642:0:1365:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961785e77800 for lustre-OST0000 00000100:00100000:2.0:1788463654.279834:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf55df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485888512:0@lo:400:kworker.0 00000100:00100000:3.0:1788463654.279854:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+24:3649:x1875339485887488:12345-0@lo:400:kworker.0 Request processed in 854us (3591us total) trans 0 rc 0/0 00010000:00080000:2.0:1788463654.279862:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618c1b25880 x1875339485889024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463654.279870:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788463654.279888:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485889024:0@lo:400:kworker.0 00000100:00100000:2.0:1788463654.279910:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485887616:0@lo:400:kworker.0 00000100:00100000:2.0:1788463654.279928:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf55fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485888128:0@lo:400:kworker.0 00000100:00100000:2.0:1788463654.279943:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf55d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485888640:0@lo:400:kworker.0 00000100:00100000:2.0:1788463654.279977:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf55ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61537c78-f571-4169-84d6-9d8a2058e62c:3649:1875339485887488:0@lo:400:kworker.0 00000100:00100000:1.0:1788463654.280208:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485888256:12345-0@lo:400:kworker.0 Request processed in 1249us (3727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463654.280218:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788463654.280243:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788463654.280253:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485887872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463654.280294:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485887872:12345-0@lo:400:kworker.0 Request processed in 44us (3744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463654.280300:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788463654.280316:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788463654.280324:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485888384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463654.280339:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf55ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485888256:0@lo:400:kworker.0 00000100:00100000:1.0:1788463654.280363:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485888384:12345-0@lo:400:kworker.0 Request processed in 37us (3738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463654.280370:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788463654.280381:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf55c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485887872:0@lo:400:kworker.0 00000100:00100000:0.0:1788463654.280399:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf55dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485888384:0@lo:400:kworker.0 00000100:00100000:0.0:1788463654.280496:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788463654.280513:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485889152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463654.280530:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485889280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463654.280599:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463654.280625:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485889408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463654.280645:0:20398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485889280 00000100:00100000:0.0:1788463654.280652:0:20398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485889280 00000100:00100000:2.0:1788463654.280675:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463654.281266:0:20398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485889408 00000100:00100000:0.0:1788463654.281272:0:20398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485889408 00000100:00100000:2.0:1788463654.281288:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788463654.281302:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485889536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463654.281305:0:20398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788463654.281327:0:20398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf557100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485889280:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788463654.281356:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1788463654.281380:0:20398:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788463654.281462:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485889536 00000100:00100000:1.0:1788463654.281471:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485889536 00000100:00100000:0.0:1788463654.281473:0:20398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf557100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485889280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 150us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463654.281497:0:20398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788463654.281524:0:20398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788463654.281535:0:20398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad76a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485889408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788463654.281557:0:20398:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788463654.281596:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788463654.281617:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485889536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788463654.281637:0:18565:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788463654.288441:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485889536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6813us (7071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463654.288460:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788463654.288565:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485889536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463654.293609:0:20398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad76a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485889408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 12066us (12924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463654.293624:0:20398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788463654.293704:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485889280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788463654.294023:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485889408:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788463654.295160:0:17036:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0a56831b-aebb-4a8f-ae8e-45964e8f9ab4 00000001:00080000:1.0:1788463654.295177:0:17036:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934638 is committed 00000020:00000080:1.0:1788463654.295182:0:17036:0:(genops.c:885:class_export_put()) final put ffff9618bf57b000/0a56831b-aebb-4a8f-ae8e-45964e8f9ab4 00000001:00100000:1.0:1788463654.295199:0:17036:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 11b4f176-a68a-42e0-807e-b5954986c863 00000001:00080000:1.0:1788463654.295211:0:17036:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:1.0:1788463654.295214:0:17036:0:(genops.c:885:class_export_put()) final put ffff961787328800/11b4f176-a68a-42e0-807e-b5954986c863 00000100:00100000:3.0:1788463654.295447:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463654.295616:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485889152 00000100:00100000:1.0:1788463654.295626:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485889152 00000100:00100000:1.0:1788463654.295692:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788463654.295707:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf555500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485889152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788463654.295731:0:18566:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788463654.295823:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf555500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485889152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463654.295830:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788463654.296012:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485889152:0@lo:13:osp-pre-1-1.0 00000020:00000080:0.0:1788463654.296993:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9618bf57b000/0a56831b-aebb-4a8f-ae8e-45964e8f9ab4 for lustre-MDT0000 00000020:00000080:0.0:1788463654.297076:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff961787328800/11b4f176-a68a-42e0-807e-b5954986c863 for lustre-MDT0000 00000020:00000080:0.0:1788463654.297111:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9618bf57e000 for lustre-MDT0000 00000020:00000080:0.0:1788463654.297117:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961787329000 for lustre-MDT0000 00010000:00010000:3.0:1788463654.534180:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463654.787740:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463654.787763:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485889664:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463654.787841:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463654.787890:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485889664 00000100:00100000:1.0:1788463654.787897:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485889664 00000100:00100000:1.0:1788463654.787950:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788463654.787959:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485889664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788463654.788005:0:18953:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788463654.788052:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485889664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463654.788060:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788463654.788110:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485889664:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463654.790727:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788463654.790746:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485889792:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463654.790805:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463654.790963:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485889792 00000100:00100000:2.0:1788463654.790971:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485889792 00000100:00100000:2.0:1788463654.791046:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788463654.791055:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485889792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788463654.791095:0:17062:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788463654.791687:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485889792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 630us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463654.791695:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788463654.794076:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485889792:0@lo:41:osp-pre-1-0.0 00000020:01000004:0.0:1788463654.852549:0:20631:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000040:00080000:3.0:1788463654.853630:0:17809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:0.0:1788463654.869143:0:20631:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788463654.869198:0:20631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c1e27000/0x841acb7f42a3a901 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a908 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.869214:0:20631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c1e27000/0x841acb7f42a3a901 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3a908 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.869223:0:20631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c1e27000/0x841acb7f42a3a901 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3a908 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.869231:0:20631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff9618c1e27000/0x841acb7f42a3a901 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3a908 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.869276:0:20631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788463654.869283:0:20631:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788463654.869309:0:20631:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788463654.869314:0:20631:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788463654.869319:0:20631:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788463654.869344:0:20631:0:(import.c:65:import_set_state_nolock()) ffff96188f415800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788463654.869407:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463654.869415:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff9618c1e27000/0x841acb7f42a3a901 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3a908 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463654.869423:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e27000 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:1.0:1788463654.869426:0:17045:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff9618c1e27000/0x841acb7f42a3a901 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3a908 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463654.869435:0:17045:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff9618c1e27000/0x841acb7f42a3a901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a3a908 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463654.869443:0:17045:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff9618c1e27000/0x841acb7f42a3a901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a3a908 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463654.869449:0:17045:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788463654.869451:0:17045:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788463654.869454:0:17045:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788463654.869482:0:17045:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff9618c1e27000/0x841acb7f42a3a901 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3a908 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463654.869499:0:17045:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463654.869524:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff9618c1e27000/0x841acb7f42a3a901 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3a908 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463654.869527:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875339485889920:0@lo:39:umount.0 00010000:00010000:1.0:1788463654.869531:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff9618c1e27000/0x841acb7f42a3a901 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3a908 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463654.869543:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463654.869544:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463654.869546:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463654.869740:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485890048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463654.873310:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463654.873450:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485890048 00000100:00100000:2.0:1788463654.873460:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485890048 00000100:00100000:2.0:1788463654.873568:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788463654.873594:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884f1e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61537c78-f571-4169-84d6-9d8a2058e62c+24:3651:x1875339485890048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788463654.873610:0:17042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463654.873629:0:17042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618c1e27200/0x841acb7f42a3a908 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x841acb7f42a3a901 expref: 24 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463654.873644:0:17042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463654.873702:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884f1e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61537c78-f571-4169-84d6-9d8a2058e62c+23:3651:x1875339485890048:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463654.873709:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788463654.873867:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463654.873940:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485890048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463654.873970:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485889920 00000100:00100000:3.0:1788463654.873974:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485889920 00000100:00100000:3.0:1788463654.874016:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788463654.874023:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875339485889920:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788463654.874047:0:17058:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a932 00000100:00080000:3.0:1788463654.874069:0:17058:0:(import.c:65:import_set_state_nolock()) ffff96188f727800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788463654.874136:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3647:x1875339485889920:12345-0@lo:39:umount.0 Request processed in 114us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463654.874142:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:3.0:1788463654.874149:0:17058:0:(genops.c:885:class_export_put()) final put ffff9618c1ae3000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788463654.874176:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff9618c1ae3000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788463654.874217:0:1365:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96188f727800 for lustre-MDT0000 00000100:00080000:3.0:1788463654.874246:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188f415800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788463654.874257:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875339485889920:0@lo:39:umount.0 00000100:00080000:0.0:1788463654.874394:0:20631:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788463654.874398:0:20631:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788463654.874402:0:20631:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788463654.874968:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463654.876538:0:20631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc0c00/0x841acb7f42a3a852 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a859 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.876559:0:20631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc0c00/0x841acb7f42a3a852 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3a859 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.876566:0:20631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc0c00/0x841acb7f42a3a852 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3a859 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.879814:0:20631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff961787bc0c00/0x841acb7f42a3a852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3a859 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.879905:0:20631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463654.879916:0:20631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc0400/0x841acb7f42a3ac5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ac65 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.879944:0:20631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc0400/0x841acb7f42a3ac5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3ac65 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.879950:0:20631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc0400/0x841acb7f42a3ac5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3ac65 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.879956:0:20631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff961787bc0400/0x841acb7f42a3ac5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3ac65 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.879971:0:20631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788463654.879984:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788463654.880001:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961787bc0c00/0x841acb7f42a3a852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3a859 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.880008:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0c00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463654.880012:0:17044:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961787bc0c00/0x841acb7f42a3a852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3a859 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.880020:0:17044:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961787bc0c00/0x841acb7f42a3a852 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a3a859 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463654.880028:0:17044:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961787bc0c00/0x841acb7f42a3a852 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a3a859 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463654.880033:0:17044:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788463654.880036:0:17044:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788463654.880072:0:17044:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961787bc0c00/0x841acb7f42a3a852 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3a859 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.880088:0:17044:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463654.880112:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961787bc0c00/0x841acb7f42a3a852 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3a859 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.880119:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961787bc0c00/0x841acb7f42a3a852 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3a859 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.880134:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463654.880138:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961787bc0400/0x841acb7f42a3ac5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3ac65 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.880143:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0400 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463654.880146:0:17044:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961787bc0400/0x841acb7f42a3ac5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3ac65 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.880153:0:17044:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961787bc0400/0x841acb7f42a3ac5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a3ac65 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463654.880159:0:17044:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961787bc0400/0x841acb7f42a3ac5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a3ac65 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463654.880164:0:17044:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788463654.880166:0:17044:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788463654.880169:0:17044:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788463654.880186:0:17044:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961787bc0400/0x841acb7f42a3ac5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3ac65 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.880192:0:17044:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463654.880197:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961787bc0400/0x841acb7f42a3ac5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3ac65 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.880214:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961787bc0400/0x841acb7f42a3ac5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3ac65 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.880224:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463654.880225:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463654.880227:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463654.880244:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61537c78-f571-4169-84d6-9d8a2058e62c:3648:1875339485890176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463654.880312:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463654.880372:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788463654.880378:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61537c78-f571-4169-84d6-9d8a2058e62c:3648:1875339485890304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463654.880399:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463654.880433:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485890176 00000100:00100000:0.0:1788463654.880440:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485890176 00000100:00100000:0.0:1788463654.880487:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485890304 00000100:00100000:0.0:1788463654.880490:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485890304 00000100:00100000:0.0:1788463654.880508:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788463654.880516:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61537c78-f571-4169-84d6-9d8a2058e62c+24:3648:x1875339485890176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788463654.880529:0:17041:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463654.880545:0:17041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618c1e26a00/0x841acb7f42a3a859 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x841acb7f42a3a852 expref: 24 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.880557:0:17041:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463654.880614:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61537c78-f571-4169-84d6-9d8a2058e62c+23:3648:x1875339485890176:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463654.880621:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788463654.880639:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788463654.880644:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61537c78-f571-4169-84d6-9d8a2058e62c+22:3648:x1875339485890304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788463654.880659:0:17041:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463654.880668:0:17041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961787bc1000/0x841acb7f42a3ac65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x841acb7f42a3ac5e expref: 22 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.880678:0:17041:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463654.880700:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61537c78-f571-4169-84d6-9d8a2058e62c+21:3648:x1875339485890304:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463654.880706:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788463654.880740:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61537c78-f571-4169-84d6-9d8a2058e62c:3648:1875339485890304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463654.880749:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61537c78-f571-4169-84d6-9d8a2058e62c:3648:1875339485890176:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788463654.880774:0:20631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0ce00/0x841acb7f42a3ae09 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ae10 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.880782:0:20631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0ce00/0x841acb7f42a3ae09 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3ae10 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.880788:0:20631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0ce00/0x841acb7f42a3ae09 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3ae10 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.880794:0:20631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff961787d0ce00/0x841acb7f42a3ae09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3ae10 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.880807:0:20631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463654.880814:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463654.880817:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961787d0ce00/0x841acb7f42a3ae09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3ae10 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463654.880925:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463654.881055:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0ce00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463654.881065:0:17044:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961787d0ce00/0x841acb7f42a3ae09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3ae10 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.881073:0:17044:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961787d0ce00/0x841acb7f42a3ae09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a3ae10 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463654.881079:0:17044:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961787d0ce00/0x841acb7f42a3ae09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a3ae10 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463654.881085:0:17044:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788463654.881087:0:17044:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788463654.881089:0:17044:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788463654.881108:0:17044:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961787d0ce00/0x841acb7f42a3ae09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3ae10 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.881114:0:17044:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788463654.881159:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61537c78-f571-4169-84d6-9d8a2058e62c:3650:1875339485890432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463654.881189:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463654.881243:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485890432 00000100:00100000:2.0:1788463654.881248:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485890432 00000100:00100000:2.0:1788463654.881279:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788463654.881286:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61537c78-f571-4169-84d6-9d8a2058e62c+21:3650:x1875339485890432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788463654.881294:0:17041:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463654.881303:0:17041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618c1e26000/0x841acb7f42a3ae10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x841acb7f42a3ae09 expref: 21 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463654.881312:0:17041:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788463654.881359:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961787d0ce00/0x841acb7f42a3ae09 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3ae10 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.881367:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961787d0ce00/0x841acb7f42a3ae09 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3ae10 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.881377:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463654.881379:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463654.881381:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463654.881392:0:20631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc0600/0x841acb7f42a3a844 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a84b expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.881400:0:20631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc0600/0x841acb7f42a3a844 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3a84b expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.881406:0:20631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc0600/0x841acb7f42a3a844 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3a84b expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.881419:0:20631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff961787bc0600/0x841acb7f42a3a844 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3a84b expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.881432:0:20631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788463654.881437:0:20631:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788463654.881440:0:20631:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1788463654.881475:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463654.881480:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961787bc0600/0x841acb7f42a3a844 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3a84b expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.881487:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0600 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463654.881490:0:17045:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961787bc0600/0x841acb7f42a3a844 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3a84b expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.881497:0:17045:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961787bc0600/0x841acb7f42a3a844 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a3a84b expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463654.881504:0:17045:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961787bc0600/0x841acb7f42a3a844 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a3a84b expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463654.881510:0:17045:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788463654.881512:0:17045:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788463654.881514:0:17045:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788463654.881529:0:17045:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961787bc0600/0x841acb7f42a3a844 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3a84b expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.881535:0:17045:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788463654.882496:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485890560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463654.882542:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463654.882609:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485890560 00000100:00100000:3.0:1788463654.882615:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485890560 00000100:00100000:3.0:1788463654.882651:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788463654.882659:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf554700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61537c78-f571-4169-84d6-9d8a2058e62c+21:3651:x1875339485890560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463654.882668:0:17042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463654.882681:0:17042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961786bde400/0x841acb7f42a3a84b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x841acb7f42a3a844 expref: 21 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463654.882694:0:17042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463654.882725:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf554700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61537c78-f571-4169-84d6-9d8a2058e62c+20:3651:x1875339485890560:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463654.882731:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788463654.882760:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485890560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788463654.883662:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61537c78-f571-4169-84d6-9d8a2058e62c+19:3650:x1875339485890432:12345-0@lo:103:ldlm_bl.0 Request processed in 2373us (2468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463654.883683:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1788463654.884185:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961787bc0600/0x841acb7f42a3a844 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3a84b expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.884207:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961787bc0600/0x841acb7f42a3a844 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3a84b expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463654.884221:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463654.884223:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463654.884226:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788463654.884242:0:20631:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788463654.884247:0:20631:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788463654.884252:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788463654.884257:0:20631:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:0.0:1788463654.884262:0:20631:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9617885bf000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788463654.884268:0:20631:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff961786899000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788463654.884272:0:20631:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9618ad68d000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788463654.884276:0:20631:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff961883732800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788463654.884280:0:20631:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff96188f9bb380) has exports, disconnecting them 00000020:00080000:0.0:1788463654.884285:0:20631:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9617885bf000), last request at 1788463654 00000020:00000080:0.0:1788463654.884292:0:20631:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3ac2d 00000100:00080000:0.0:1788463654.884311:0:20631:0:(import.c:65:import_set_state_nolock()) ffff9617885be000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788463654.884406:0:20631:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9617885bf000): rc 0 00000020:00000080:0.0:1788463654.884409:0:20631:0:(genops.c:885:class_export_put()) final put ffff9617885bf000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788463654.884425:0:20631:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff961786899000), last request at 1788463654 00000020:00000080:0.0:1788463654.884428:0:20631:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3aacf 00000100:00080000:0.0:1788463654.884434:0:20631:0:(import.c:65:import_set_state_nolock()) ffff96178689e800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788463654.884463:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9617885bf000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788463654.884512:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9617885be000 for lustre-MDT0000 00000100:00100000:1.0:1788463654.884621:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61537c78-f571-4169-84d6-9d8a2058e62c:3650:1875339485890432:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788463654.884743:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788463654.884979:0:20631:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff961786899000): rc 0 00000020:00000080:0.0:1788463654.884982:0:20631:0:(genops.c:885:class_export_put()) final put ffff961786899000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788463654.885033:0:20631:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9618ad68d000), last request at 1788463562 00000020:00000080:0.0:1788463654.885044:0:20631:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3aa20 00000100:00080000:0.0:1788463654.885048:0:20631:0:(import.c:65:import_set_state_nolock()) ffff9618ad68c800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788463654.885071:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788463654.885107:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff961786899000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788463654.885146:0:1365:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96178689e800 for lustre-MDT0000 00000020:00080000:0.0:1788463654.885292:0:20631:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9618ad68d000): rc 0 00000020:00000080:0.0:1788463654.885295:0:20631:0:(genops.c:885:class_export_put()) final put ffff9618ad68d000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788463654.885340:0:20631:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff961883732800), last request at 1788463562 00000020:00000080:0.0:1788463654.885344:0:20631:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a9c5 00000100:00080000:0.0:1788463654.885348:0:20631:0:(import.c:65:import_set_state_nolock()) ffff961883734000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788463654.885365:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788463654.885385:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9618ad68d000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788463654.885422:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9618ad68c800 for lustre-MDT0000 00000001:00000004:0.0:1788463654.885518:0:20631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000020:00080000:0.0:1788463654.885636:0:20631:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff961883732800): rc 0 00000004:00000080:0.0:1788463654.885643:0:20631:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffba4745703ae0 00000100:00080000:0.0:1788463654.885662:0:20631:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788463654.885665:0:20631:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788463654.886433:0:20631:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788463654.886459:0:20631:0:(import.c:65:import_set_state_nolock()) ffff961786882800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788463654.886906:0:20631:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788463654.886910:0:20631:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000100:00100000:3.0:1788463654.887015:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485890688:0@lo:39:umount.0 00000100:00100000:3.0:1788463654.887094:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463654.887147:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485890688 00000100:00100000:3.0:1788463654.887155:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485890688 00000100:00100000:3.0:1788463654.887196:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788463654.887204:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875339485890688:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788463654.887231:0:17061:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3aa4a 00000100:00080000:3.0:1788463654.887237:0:17061:0:(import.c:65:import_set_state_nolock()) ffff9618add21000 : changing import state from FULL to CLOSED 00000004:00080000:0.0:1788463654.887260:0:20631:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788463654.887317:0:20631:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788463654.887329:0:20631:0:(import.c:65:import_set_state_nolock()) ffff96188ced9800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788463654.887340:0:20631:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788463654.887342:0:20631:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1788463654.887352:0:20631:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788463654.887414:0:20631:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788463654.887424:0:20631:0:(import.c:65:import_set_state_nolock()) ffff961787d22000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788463654.887466:0:20631:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff96188f9bb380) has no exports 00010000:00010000:1.0:1788463654.887975:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788463654.888288:0:17061:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788463654.888441:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3647:x1875339485890688:12345-0@lo:39:umount.0 Request processed in 1235us (1345us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788463654.888451:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788463654.888497:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485890816:0@lo:9:umount.0 00000100:00100000:3.0:1788463654.888530:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463654.888564:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485890944:0@lo:9:umount.0 00000100:00100000:3.0:1788463654.888610:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788463654.888645:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961786882800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788463654.888653:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485890688:0@lo:39:umount.0 00000100:00100000:3.0:1788463654.888674:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485890816 00000100:00100000:3.0:1788463654.888679:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485890816 00000100:00100000:3.0:1788463654.888710:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485890944 00000100:00100000:3.0:1788463654.888714:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485890944 00000100:00100000:3.0:1788463654.888733:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788463654.888742:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875339485890816:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788463654.888761:0:18564:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3ab15 00000100:00080000:3.0:1788463654.888779:0:18564:0:(import.c:65:import_set_state_nolock()) ffff961786a79800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788463654.888813:0:18564:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1788463654.888918:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3647:x1875339485890816:12345-0@lo:9:umount.0 Request processed in 176us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463654.888925:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788463654.888937:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788463654.888944:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875339485890944:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788463654.888953:0:18564:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3ac6c 00000100:00080000:3.0:1788463654.888958:0:18564:0:(import.c:65:import_set_state_nolock()) ffff961786a78800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788463654.888972:0:18564:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788463654.889048:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3647:x1875339485890944:12345-0@lo:9:umount.0 Request processed in 104us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463654.889054:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788463654.889083:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188ced9800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788463654.889093:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788463654.889095:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788463654.889098:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485890816:0@lo:9:umount.0 00000100:00080000:3.0:1788463654.889108:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961787d22000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788463654.889114:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788463654.889115:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788463654.889117:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485890944:0@lo:9:umount.0 00010000:00010000:3.0:1788463654.889140:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463654.889330:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788463654.896459:0:20631:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff96188f9bb380) has no exports 00000020:00000080:2.0:1788463654.962179:0:20631:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a89f 00000020:00000080:2.0:1788463654.962195:0:20631:0:(genops.c:885:class_export_put()) final put ffff961787d20800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788463654.962213:0:20631:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788463654.963194:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff961787d20800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788463654.963225:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788463654.963236:0:20631:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788463654.963241:0:20631:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff961787c98000) has no exports 00000020:00000080:3.0:1788463654.963689:0:20631:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a898 00000020:00000080:3.0:1788463654.963696:0:20631:0:(genops.c:885:class_export_put()) final put ffff9618a5faa800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788463654.963747:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788463654.963767:0:20631:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788463654.963770:0:20631:0:(genops.c:885:class_export_put()) final put ffff9618a5fac000/lustre-QMT0000_UUID 00000020:00000080:3.0:1788463654.963773:0:20631:0:(genops.c:844:class_export_destroy()) destroying export ffff9618a5fac000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788463654.963777:0:20631:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788463654.963903:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff9618a5faa800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1788463655.555861:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463656.579815:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463657.604100:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463658.631736:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463659.398070:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485891456:0@lo:400:kworker.0 00000100:00100000:1.0:1788463659.398149:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463659.399427:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485891200:0@lo:400:kworker.0 00000100:00100000:0.0:1788463659.399487:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463659.399549:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485891200 00000100:00100000:0.0:1788463659.399557:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485891200 00000100:00100000:0.0:1788463659.399614:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788463659.399622:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1875339485891200:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788463659.399631:0:17062:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788463659.399672:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1875339485891200:12345-0@lo:400:kworker.0 Request processed in 50us (186us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788463659.399680:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788463659.399716:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61537c78-f571-4169-84d6-9d8a2058e62c:3648:1875339485891072:0@lo:400:kworker.0 00000100:00100000:2.0:1788463659.399755:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463659.399803:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485891456 00000100:00100000:2.0:1788463659.399807:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485891456 00000100:00100000:2.0:1788463659.399850:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788463659.399858:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485891456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463659.399861:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485891328:0@lo:400:kworker.0 00000100:00100000:0.0:1788463659.399916:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463659.399921:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485891456:12345-0@lo:400:kworker.0 Request processed in 63us (1771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463659.399930:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788463659.399943:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485891328 00000100:00100000:2.0:1788463659.399946:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485891328 00000100:00100000:2.0:1788463659.399970:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788463659.399978:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485891328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463659.400021:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485891328:12345-0@lo:400:kworker.0 Request processed in 45us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463659.400027:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1788463659.400041:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788463659.400050:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788463659.400648:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485891456:0@lo:400:kworker.0 00000100:00100000:1.0:1788463659.400658:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875339485891968:0@lo:400:kworker.0 00000100:00100000:1.0:1788463659.400688:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788463659.401062:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788463659.401067:0:3649:0:(import.c:65:import_set_state_nolock()) ffff96189154e000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788463659.401071:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788463659.401788:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485891072 00000100:00100000:3.0:1788463659.401796:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485891072 00000100:00100000:3.0:1788463659.401841:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788463659.401851:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+19:3648:x1875339485891072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463659.401881:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485891584:0@lo:400:kworker.0 00000100:00100000:3.0:1788463659.401917:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+19:3648:x1875339485891072:12345-0@lo:400:kworker.0 Request processed in 66us (2159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463659.401925:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788463659.401939:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463659.401975:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485891968 00000100:00100000:3.0:1788463659.401979:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485891968 00000100:00100000:1.0:1788463659.401981:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485892096:0@lo:400:kworker.0 00000100:00100000:3.0:1788463659.402004:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485891584 00000100:00100000:3.0:1788463659.402009:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485891584 00000100:00100000:1.0:1788463659.402010:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463659.402047:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61537c78-f571-4169-84d6-9d8a2058e62c:3648:1875339485891072:0@lo:400:kworker.0 00000100:00100000:1.0:1788463659.402062:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463659.402070:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485892224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788463659.402087:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485891328:0@lo:400:kworker.0 00000100:00100000:0.0:1788463659.402098:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485891840:0@lo:400:kworker.0 00000100:00100000:1.0:1788463659.402101:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463659.402136:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463659.413424:0:20398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485892224 00000100:00100000:0.0:1788463659.413438:0:20398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485892224 00000100:00100000:0.0:1788463659.413502:0:20398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788463659.413512:0:20398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485892224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788463659.413544:0:20398:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788463659.413636:0:20398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485892224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (11537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463659.413644:0:20398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788463659.413701:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485892224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788463659.413832:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788463659.413843:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485892352:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788463659.413881:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463659.417778:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485892096 00000100:00100000:3.0:1788463659.417794:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485892096 00000100:00100000:3.0:1788463659.417834:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485892352 00000100:00100000:3.0:1788463659.417837:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485892352 00000100:00100000:3.0:1788463659.417921:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788463659.421143:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485892352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788463659.421189:0:18565:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788463659.421781:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485891840 00000100:00100000:0.0:1788463659.421806:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485891840 00000100:00100000:0.0:1788463659.421877:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788463659.421888:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485891840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463659.421992:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485891840:12345-0@lo:400:kworker.0 Request processed in 105us (19854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463659.422000:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788463659.422026:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788463659.422035:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788463659.422037:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1875339485891968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463659.422045:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1875339485891584:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788463659.422049:0:18932:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000020:00080000:0.0:1788463659.422056:0:17058:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788463659.422108:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1875339485891968:12345-0@lo:400:kworker.0 Request processed in 73us (21418us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788463659.422112:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1875339485891584:12345-0@lo:400:kworker.0 Request processed in 66us (20172us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788463659.422119:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788463659.422126:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1788463659.422166:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788463659.422171:0:3651:0:(import.c:65:import_set_state_nolock()) ffff96178732a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788463659.422175:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788463659.422178:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788463659.422182:0:3651:0:(import.c:65:import_set_state_nolock()) ffff96178732a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788463659.422183:0:3648:0:(import.c:65:import_set_state_nolock()) ffff96188cf2a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788463659.422191:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788463659.422193:0:3651:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 637 00000100:00080000:1.0:1788463659.422201:0:3651:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96178732a800 using connection 192.168.204.153@tcp/0@lo 00000100:00080000:0.0:1788463659.422204:0:3648:0:(import.c:65:import_set_state_nolock()) ffff96188cf2a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788463659.422210:0:3648:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 602 00000100:00080000:0.0:1788463659.422215:0:3648:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96188cf2a000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:1.0:1788463659.422231:0:3651:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff961786b47100 x1875339485892480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788463659.422238:0:3648:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96189162aa00 x1875339485892608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788463659.422258:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485891584:0@lo:400:kworker.0 00000100:00100000:1.0:1788463659.422259:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875339485891968:0@lo:400:kworker.0 00010000:00080000:0.0:1788463659.422314:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188d1d0000 x1875339485891840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463659.422326:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485891840:0@lo:400:kworker.0 00000100:00100000:1.0:1788463659.422335:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875339485892480:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788463659.422386:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463659.422418:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96189162aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875339485892608:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788463659.422425:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485892480 00000100:00100000:0.0:1788463659.422430:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485892480 00000100:00100000:1.0:1788463659.422444:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463659.422544:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485892352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4613us (8660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463659.422552:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788463659.422632:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485892352:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788463659.424799:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485892608 00000100:00100000:0.0:1788463659.424814:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485892608 00000100:00100000:0.0:1788463659.424866:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788463659.424884:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788463659.424886:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485892096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463659.424895:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875339485892480:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1788463659.424928:0:18932:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788463659.425020:0:17056:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788463659.425041:0:17056:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1788463659.425401:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485892096:12345-0@lo:400:kworker.0 Request processed in 525us (23390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463659.425409:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788463659.425429:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788463659.425433:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875339485892608:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1788463659.425443:0:17058:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788463659.425503:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875339485892608:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 67us (3058us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788463659.425509:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:0.0:1788463659.425553:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188d1d3b80 x1875339485892096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463659.425567:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485892096:0@lo:400:kworker.0 00000100:00080000:0.0:1788463659.425632:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188cf2a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788463659.425638:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788463659.425641:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96189162aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875339485892608:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1788463659.425671:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788463659.432949:0:3649:0:(import.c:65:import_set_state_nolock()) ffff96189154e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788463659.432960:0:3649:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 602 00000100:00080000:2.0:1788463659.432970:0:3649:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff96189154e000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:2.0:1788463659.433026:0:3649:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9618ad768380 x1875339485892736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788463659.433066:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485891200:0@lo:400:kworker.0 00000100:00100000:2.0:1788463659.433078:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485891712:0@lo:400:kworker.0 00000100:00100000:2.0:1788463659.433143:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463659.433195:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485891712 00000100:00100000:2.0:1788463659.433202:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485891712 00000100:00100000:2.0:1788463659.433243:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788463659.433251:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875339485891712:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788463659.433259:0:17058:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788463659.433308:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875339485891712:12345-0@lo:400:kworker.0 Request processed in 56us (164us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788463659.433316:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1788463659.433361:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788463659.433365:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9617873b8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788463659.433368:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788463659.433372:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9617873b8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788463659.433376:0:3649:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 618 00000100:00080000:2.0:1788463659.433394:0:3649:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9617873b8000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:2.0:1788463659.433408:0:3649:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9618ad76b480 x1875339485892864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788463659.433419:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485891712:0@lo:400:kworker.0 00000100:00100000:3.0:1788463659.434466:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485892736:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788463659.434521:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463659.434551:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875339485892864:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788463659.434615:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463659.434654:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485892864 00000100:00100000:2.0:1788463659.434654:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485892736 00000100:00100000:2.0:1788463659.434659:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485892736 00000100:00100000:3.0:1788463659.434660:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485892864 00000100:00100000:3.0:1788463659.434687:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788463659.434687:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788463659.434693:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875339485892864:12345-0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788463659.434693:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3647:x1875339485892736:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1788463659.434709:0:18953:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788463659.435424:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3647:x1875339485892736:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 728us (900us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788463659.435433:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1788463659.437464:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96189154e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788463659.437476:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788463659.437481:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485892736:0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1788463659.438366:0:17056:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788463659.438502:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875339485892864:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 3806us (3884us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788463659.438513:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1788463659.440446:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9617873b8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788463659.440455:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788463659.440460:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875339485892864:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788463659.443373:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875339485892480:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 18472us (20979us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788463659.443389:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1788463659.443424:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96178732a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788463659.443431:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788463659.443436:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875339485892480:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:3.0:1788463659.652166:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788463660.422452:0:17036:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788463660.422463:0:17036:0:(genops.c:885:class_export_put()) final put ffff961883732800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788463660.422980:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff961883732800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1788463660.423036:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961883734000 for lustre-MDT0000 00000001:00100000:3.0:1788463660.423320:0:17789:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788463660.423331:0:17789:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:3.0:1788463660.423334:0:17789:0:(genops.c:885:class_export_put()) final put ffff9618ad68b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788463660.423445:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9618ad68b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788463660.423480:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9618add21000 for lustre-MDT0001 00000001:00100000:3.0:1788463660.423547:0:18558:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788463660.423551:0:18558:0:(genops.c:885:class_export_put()) final put ffff961786a78000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788463660.423678:0:19378:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788463660.423682:0:19378:0:(genops.c:885:class_export_put()) final put ffff961786a7a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788463660.423780:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff961786a78000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788463660.423804:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff961786a7a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788463660.423819:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961786a79800 for lustre-OST0000 00000020:00000080:1.0:1788463660.423823:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961786a78800 for lustre-OST0001 00010000:00010000:2.0:1788463660.676031:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788463661.060535:0:20631:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff961891f40420 - data ffff96188bcea0d8/ffff961781729800 00000020:01000000:3.0:1788463661.060724:0:20631:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff961787972d80 - data ffff96188befc438/ffff96188e7a8400 00000001:00000004:3.0:1788463661.083220:0:20631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000100:00080000:1.0:1788463661.135301:0:20631:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788463661.135311:0:20631:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788463661.135327:0:20631:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff96188fc23b80 x1875339485890688/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788463664 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463661.135354:0:20631:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788463661.140343:0:20631:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788463661.140352:0:20631:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:1.0:1788463661.140386:0:20631:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788463661.140389:0:20631:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788463661.141535:0:17080:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788463661.141540:0:17080:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:2.0:1788463661.141553:0:17080:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1788463661.142444:0:20631:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788463661.142462:0:20631:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:1.0:1788463661.142482:0:20631:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788463661.142485:0:20631:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788463661.143129:0:17082:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788463661.143133:0:17082:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:2.0:1788463661.143143:0:17082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1788463661.145182:0:20631:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a867 00000020:00000080:1.0:1788463661.145199:0:20631:0:(genops.c:885:class_export_put()) final put ffff961885e43800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788463661.145994:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff961885e43800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788463661.149527:0:20631:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a87c 00000020:00000080:1.0:1788463661.149540:0:20631:0:(genops.c:885:class_export_put()) final put ffff961885475000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788463661.149549:0:20631:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788463661.149553:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788463661.149562:0:20631:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788463661.149566:0:20631:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff96188f9b99c0) has no exports 00000020:00000080:3.0:1788463661.150183:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff961885475000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1788463661.150281:0:20631:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788463661.150291:0:20631:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a8de 00000020:00000080:1.0:1788463661.150297:0:20631:0:(genops.c:885:class_export_put()) final put ffff9618c1ae6000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788463661.150310:0:20631:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788463661.150315:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788463661.150321:0:20631:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788463661.150324:0:20631:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff96178790cd40) has no exports 00000020:00000080:1.0:1788463661.150332:0:20631:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a8d7 00000020:00000080:1.0:1788463661.150337:0:20631:0:(genops.c:885:class_export_put()) final put ffff961885e44000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788463661.150550:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff9618c1ae6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788463661.150596:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff961885e44000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788463661.152111:0:20631:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788463661.152117:0:20631:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788463661.152121:0:20631:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1788463661.152130:0:20631:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788463661.152133:0:20631:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788463661.152227:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788463661.152237:0:20631:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788463661.152246:0:20631:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a8c9 00000020:00000080:1.0:1788463661.152255:0:20631:0:(genops.c:885:class_export_put()) final put ffff96188cedb000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788463661.157743:0:1365:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961787d22000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788463661.157762:0:1365:0:(genops.c:885:class_export_put()) final put ffff96188cedd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788463661.157765:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff96188cedd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788463661.157777:0:1365:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788463661.168086:0:20631:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788463661.168120:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788463661.168132:0:20631:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788463661.168137:0:20631:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff961787908000) has no exports 00000020:00000080:1.0:1788463661.168155:0:20631:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a8c2 00000020:00000080:1.0:1788463661.168165:0:20631:0:(genops.c:885:class_export_put()) final put ffff96188cedc000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788463661.168700:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff96188cedb000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788463661.168716:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff96188cedc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788463661.168799:0:20631:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788463661.168803:0:20631:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788463661.168807:0:20631:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:1.0:1788463661.168812:0:20631:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788463661.168815:0:20631:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788463661.169082:0:1365:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96188ced9800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788463661.169130:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788463661.169139:0:20631:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788463661.169143:0:20631:0:(genops.c:885:class_export_put()) final put ffff961787d27000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788463661.169146:0:20631:0:(genops.c:844:class_export_destroy()) destroying export ffff961787d27000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788463661.169155:0:20631:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788463661.169246:0:20631:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788463661.169253:0:20631:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a8b4 00000020:00000080:1.0:1788463661.169257:0:20631:0:(genops.c:885:class_export_put()) final put ffff96189021d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788463661.169271:0:20631:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788463661.169275:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788463661.169280:0:20631:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788463661.169282:0:20631:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff96188fbd4d40) has no exports 00000020:00000080:1.0:1788463661.169287:0:20631:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a8ad 00000020:00000080:1.0:1788463661.169290:0:20631:0:(genops.c:885:class_export_put()) final put ffff961786882000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788463661.169901:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff96189021d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788463661.169912:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff961786882000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788463661.194998:0:20631:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1788463661.195007:0:20631:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788463661.195012:0:20631:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788463661.195020:0:20631:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788463661.195077:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788463661.195088:0:20631:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788463661.195117:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788463661.195120:0:20631:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788463661.195126:0:20631:0:(genops.c:885:class_export_put()) final put ffff96188f720000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788463661.195130:0:20631:0:(genops.c:844:class_export_destroy()) destroying export ffff96188f720000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788463661.195151:0:20631:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788463661.195247:0:1365:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961786882800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788463661.195254:0:20631:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a883 00000020:00000080:3.0:1788463661.195257:0:1365:0:(genops.c:885:class_export_put()) final put ffff961787d23800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788463661.195261:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff961787d23800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788463661.195263:0:20631:0:(genops.c:885:class_export_put()) final put ffff961885473800/lustre-MDD0000_UUID 00000020:01000000:3.0:1788463661.195269:0:1365:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788463661.195278:0:20631:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788463661.195293:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788463661.195299:0:20631:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788463661.195302:0:20631:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff96188f9b8000) has no exports 00000020:00000080:1.0:1788463661.195322:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788463661.195325:0:20631:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788463661.195329:0:20631:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a88a 00000020:00000080:1.0:1788463661.195333:0:20631:0:(genops.c:885:class_export_put()) final put ffff9618850d5000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788463661.195353:0:20631:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96189154b000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788463661.195356:0:20631:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96189154b000 3 00000020:01000004:1.0:1788463661.195359:0:20631:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96189154b000 from lustre-MDT0000 00000020:00000080:1.0:1788463661.195377:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788463661.195380:0:20631:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788463661.195382:0:20631:0:(genops.c:885:class_export_put()) final put ffff961885e41000/lustre-MDT0000_UUID 00000020:00000080:1.0:1788463661.195384:0:20631:0:(genops.c:844:class_export_destroy()) destroying export ffff961885e41000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788463661.195390:0:20631:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788463661.195417:0:20631:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1788463661.195421:0:20631:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788463661.195423:0:20631:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788463661.195425:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788463661.195428:0:20631:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788463661.195434:0:20631:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff96188d0ea800 61537c78-f571-4169-84d6-9d8a2058e62c 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788463661.195438:0:20631:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff96178790b380) has exports, disconnecting them 00000020:00080000:1.0:1788463661.195442:0:20631:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff96188d0ea800), last request at 1788463547 00000020:00000080:1.0:1788463661.195456:0:20631:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a82f 00000020:00010000:1.0:1788463661.195460:0:20631:0:(genops.c:1921:obd_stale_export_put()) Put export ffff96188d0ea800: total 2 00000100:00080000:1.0:1788463661.195463:0:20631:0:(import.c:65:import_set_state_nolock()) ffff96188d0ed000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788463661.195556:0:20631:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96188d0ea800): rc 0 00000020:00080000:1.0:1788463661.195565:0:20631:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff96178790b380) has no exports 00000100:00100000:1.0:1788463661.196697:0:17050:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9618915bb600:17050] 1 exiting: rc = 0 00000100:00100000:2.0:1788463661.197340:0:17051:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9618915bb800:17051] 2 exiting: rc = 0 00000020:00000080:3.0:1788463661.197519:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff961885473800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788463661.197526:0:1365:0:(genops.c:885:class_export_put()) final put ffff9618850d2000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788463661.197529:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff9618850d2000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788463661.197533:0:1365:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788463661.197570:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff9618850d5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1788463661.197608:0:17049:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff961787278800:17049] 0 exiting: rc = 1 00000100:00100000:1.0:1788463661.197656:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197665:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197672:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197681:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:3.0:1788463661.197686:0:17045:0:(genops.c:1907:obd_stale_export_get()) Get export ffff96188d0ea800: total 0 00000100:00100000:1.0:1788463661.197692:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788463661.197693:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463661.197700:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197712:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197721:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197726:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197733:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197739:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197745:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197753:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197758:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197764:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197769:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197774:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197780:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197786:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197792:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197798:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197803:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197808:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197813:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197819:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197826:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197833:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197838:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197843:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197849:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197854:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197859:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197879:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197898:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197904:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197910:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197915:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197920:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197925:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197931:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197936:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197940:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197946:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197951:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197957:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197962:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197968:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197972:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197977:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197983:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197988:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197992:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.197998:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.198003:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.198007:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.198012:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.198017:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.198022:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.198027:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.198031:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.198036:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.198041:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.198046:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463661.198050:0:20631:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788463661.198194:0:17045:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff96188d0ea800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788463661.198232:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96188f6f5e00/0x841acb7f42a3adf4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x841acb7f42a3aded expref: 14 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463661.198268:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961787bc0200/0x841acb7f42a3a96a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x841acb7f42a3a963 expref: 13 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463661.198280:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961882813e00/0x841acb7f42a3ac18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x841acb7f42a3ac11 expref: 12 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463661.198295:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961787d0ca00/0x841acb7f42a3a83d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x841acb7f42a3a836 expref: 11 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463661.198308:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961882813200/0x841acb7f42a3ac57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x841acb7f42a3ac50 expref: 10 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463661.198327:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618c1e27800/0x841acb7f42a3ae02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x841acb7f42a3adfb expref: 9 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463661.198340:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961787d0d200/0x841acb7f42a3ade6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x841acb7f42a3addf expref: 8 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463661.198358:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961787d0de00/0x841acb7f42a3abee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x841acb7f42a3abe7 expref: 7 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463661.198389:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961787d0d400/0x841acb7f42a3aa90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x841acb7f42a3aa89 expref: 6 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463661.198515:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961787d0c600/0x841acb7f42a3a94e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x841acb7f42a3a947 expref: 5 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463661.198536:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961786bdf400/0x841acb7f42a3aaba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x841acb7f42a3aab3 expref: 4 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463661.198562:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961786bdfa00/0x841acb7f42a3aa0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x841acb7f42a3aa04 expref: 3 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463661.198618:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961787bc0e00/0x841acb7f42a3a95c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x841acb7f42a3a955 expref: 2 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463661.198630:0:17045:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff96188d0ea800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788463661.198654:0:17045:0:(genops.c:885:class_export_put()) final put ffff96188d0ea800/61537c78-f571-4169-84d6-9d8a2058e62c 00010000:00010000:3.0:1788463661.198670:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463661.198673:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463661.198676:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788463661.198755:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff96188d0ea800/61537c78-f571-4169-84d6-9d8a2058e62c for MGS 00000020:00000080:2.0:1788463661.198801:0:1365:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96188d0ed000 for MGS 00000020:01000000:1.0:1788463661.199746:0:20631:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff961787382ea0 - data ffff96188bf44000/ffff961786b04000 00000020:01000000:1.0:1788463661.200116:0:20631:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9618903fcae0 - data ffff9618996f60d8/ffff961884f1c000 00000020:00000080:1.0:1788463661.201059:0:20631:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a813 00000020:00000080:1.0:1788463661.201076:0:20631:0:(genops.c:885:class_export_put()) final put ffff96189154b800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788463661.201087:0:20631:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96189154b000 from MGS, refs=2 00000020:01000004:1.0:1788463661.201090:0:20631:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96189154b000 2 00000020:01000004:1.0:1788463661.201093:0:20631:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96189154b000 from MGS 00000020:00000080:1.0:1788463661.201120:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788463661.201126:0:20631:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788463661.201128:0:20631:0:(genops.c:885:class_export_put()) final put ffff96189154f800/MGS 00000020:00000080:1.0:1788463661.201131:0:20631:0:(genops.c:844:class_export_destroy()) destroying export ffff96189154f800/MGS for MGS 00000020:01000000:1.0:1788463661.201137:0:20631:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:3.0:1788463661.201226:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96189154b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788463661.201338:0:20631:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788463661.201343:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788463661.201349:0:20631:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788463661.201356:0:20631:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff96188f414800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788463661.201505:0:20631:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff96188d3a19c0) has exports, disconnecting them 00000020:00080000:1.0:1788463661.201512:0:20631:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff96188f414800), last request at 1788463547 00000020:00000080:1.0:1788463661.201516:0:20631:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a916 00000020:00080000:1.0:1788463661.201526:0:20631:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96188f414800): rc 0 00000020:00000080:1.0:1788463661.201530:0:20631:0:(genops.c:885:class_export_put()) final put ffff96188f414800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788463661.206311:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96188f414800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788463661.215707:0:20631:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788463661.215716:0:20631:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788463661.215729:0:20631:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788463661.215735:0:20631:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788463661.215895:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96188f415800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788463661.215954:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788463661.215963:0:20631:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788463661.215969:0:20631:0:(genops.c:885:class_export_put()) final put ffff96188f416000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788463661.215972:0:20631:0:(genops.c:844:class_export_destroy()) destroying export ffff96188f416000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788463661.215978:0:20631:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788463661.216052:0:20631:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96189154b000 1 00000020:00000080:2.0:1788463661.216058:0:20631:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a805 00000020:00000080:2.0:1788463661.216064:0:20631:0:(genops.c:885:class_export_put()) final put ffff96189154c800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788463661.216201:0:20631:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788463661.216205:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788463661.216210:0:20631:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788463661.216216:0:20631:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9617879099c0) has no exports 00000020:00000080:3.0:1788463661.218234:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96189154c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788463661.246879:0:20631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788463661.246893:0:20631:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788463661.246899:0:20631:0:(genops.c:885:class_export_put()) final put ffff96189154d000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788463661.246905:0:20631:0:(genops.c:844:class_export_destroy()) destroying export ffff96189154d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788463661.246917:0:20631:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788463661.247037:0:20631:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff961891549000 00000020:02000400:2.0:1788463661.247098:0:20631:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788463661.699852:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463662.723941:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463663.751724:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788463664.069698:0:17809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788463664.516361:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485892992:0@lo:400:kworker.0 00000400:00000100:1.0:1788463664.516421:0:3651:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875339485892992 offset 0 length 224: 4 00000100:00080000:3.0:1788463664.516508:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788463664.516514:0:1365:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788463664.516518:0:1365:0:(import.c:65:import_set_state_nolock()) ffff96189154e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788463664.516523:0:1365:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 698 00000100:00080000:3.0:1788463664.516529:0:1365:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788463664.516536:0:1365:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff96189154e000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463664.516560:0:1365:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9618884f6300 x1875339485893120/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788463664.516830:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788463664.516834:0:1365:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788463664.516852:0:1365:0:(import.c:65:import_set_state_nolock()) ffff96188cf2a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788463664.516856:0:1365:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 698 00000100:00080000:3.0:1788463664.516860:0:1365:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788463664.516864:0:1365:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96188cf2a000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463664.516878:0:1365:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9618884f4380 x1875339485893504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788463664.516886:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788463664.516890:0:1365:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788463664.516892:0:1365:0:(import.c:65:import_set_state_nolock()) ffff9617873b8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788463664.516895:0:1365:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 698 00000100:00080000:3.0:1788463664.516897:0:1365:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788463664.516901:0:1365:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9617873b8000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463664.516909:0:1365:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9618884f6a00 x1875339485893632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788463664.516927:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788463664.516930:0:1365:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788463664.516932:0:1365:0:(import.c:65:import_set_state_nolock()) ffff96178732a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788463664.516935:0:1365:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 698 00000100:00080000:3.0:1788463664.516938:0:1365:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788463664.516941:0:1365:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96178732a800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463664.516950:0:1365:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9618884f6d80 x1875339485893888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788463664.516979:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485893760:0@lo:400:kworker.0 00000100:00100000:3.0:1788463664.517021:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463664.517053:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463664.517059:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485894016:0@lo:400:kworker.0 00000100:00100000:3.0:1788463664.517081:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463664.517188:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485893120:0@lo:38:kworker.0 00000100:00100000:1.0:1788463664.517221:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463664.517244:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875339485893504:0@lo:38:kworker.0 00000100:00100000:1.0:1788463664.517719:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463664.517750:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875339485893632:0@lo:38:kworker.0 00000100:00100000:0.0:1788463664.517754:0:20632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485893760 00000100:00100000:0.0:1788463664.517766:0:20632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485893760 00000100:00100000:1.0:1788463664.517779:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463664.517809:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875339485893888:0@lo:38:kworker.0 00000100:00100000:0.0:1788463664.517834:0:20632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485894016 00000100:00100000:1.0:1788463664.517836:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463664.517840:0:20632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485894016 00000100:00100000:0.0:1788463664.517860:0:20632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485893504 00000100:00100000:0.0:1788463664.517864:0:20632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485893504 00000100:00100000:0.0:1788463664.517877:0:20632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485893632 00000100:00100000:0.0:1788463664.517879:0:20632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485893632 00000100:00100000:1.0:1788463664.517880:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485893888 00000100:00100000:1.0:1788463664.517887:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485893888 00000100:00100000:1.0:1788463664.517910:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788463664.517919:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485893760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463664.517962:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485893760:12345-0@lo:400:kworker.0 Request processed in 45us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463664.517969:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788463664.517986:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788463664.517992:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485894016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463664.518018:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485894016:12345-0@lo:400:kworker.0 Request processed in 26us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463664.518026:0:20632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788463664.518034:0:20632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1875339485893504:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788463664.518053:0:20632:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1788463664.518101:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9618884f7100 x1875339485894016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463664.518114:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485894016:0@lo:400:kworker.0 00010000:00080000:3.0:1788463664.518126:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9618884f7480 x1875339485893760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463664.518134:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485893760:0@lo:400:kworker.0 00000100:00100000:3.0:1788463664.518179:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485893248:0@lo:400:kworker.0 00000100:00100000:3.0:1788463664.518204:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463664.518225:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96189162aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485894144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463664.518246:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463664.519386:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788463664.519402:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485893376:0@lo:400:kworker.0 00000100:00100000:3.0:1788463664.519450:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463664.519482:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485894272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463664.519504:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463664.519531:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485893248 00000100:00100000:2.0:1788463664.519541:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485893248 00000100:00100000:2.0:1788463664.519607:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485893376 00000100:00100000:2.0:1788463664.519610:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485893376 00000100:00100000:2.0:1788463664.519642:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788463664.519652:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485893248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463664.519709:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485893248:12345-0@lo:400:kworker.0 Request processed in 59us (1504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463664.519727:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788463664.519742:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788463664.519748:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485893376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463664.519775:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485893376:12345-0@lo:400:kworker.0 Request processed in 28us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463664.519780:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788463664.526872:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788463664.526924:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788463664.526932:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875339485893632:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788463664.526956:0:18932:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788463664.527047:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875339485893632:12345-0@lo:38:kworker.0 Request processed in 114us (9267us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788463664.527054:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788463664.527068:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788463664.527073:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875339485893888:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788463664.527083:0:18932:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788463664.527108:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875339485893888:12345-0@lo:38:kworker.0 Request processed in 34us (9272us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788463664.527115:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788463664.527338:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485893120 00000100:00100000:3.0:1788463664.527348:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485893120 00000100:00100000:3.0:1788463664.527389:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788463664.527394:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875339485893120:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788463664.527406:0:17061:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788463664.527435:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875339485893120:12345-0@lo:38:kworker.0 Request processed in 40us (10213us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788463664.527452:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788463664.527479:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485894144 00000100:00100000:3.0:1788463664.527483:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485894144 00000100:00100000:3.0:1788463664.527507:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485894272 00000100:00100000:3.0:1788463664.527510:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485894272 00000100:00100000:3.0:1788463664.527521:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788463664.527526:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485894144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788463664.527551:0:18566:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00080000:2.0:1788463664.534497:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96189154e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1788463664.534560:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485894144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7020us (16299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463664.534593:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1788463664.534595:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788463664.534601:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485893120:0@lo:38:kworker.0 00000100:00080000:2.0:1788463664.534620:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9617873b8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788463664.534624:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788463664.534627:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875339485893632:0@lo:38:kworker.0 00000100:00080000:2.0:1788463664.534780:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96178732a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788463664.534785:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788463664.534789:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875339485893888:0@lo:38:kworker.0 00000100:00100000:3.0:1788463664.534853:0:20398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788463664.534882:0:20398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485894272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788463664.534916:0:20398:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788463664.534971:0:20398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485894272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (15465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463664.534978:0:20398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788463664.535022:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485893376:0@lo:400:kworker.0 00000100:00100000:3.0:1788463664.535038:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485894272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463664.535056:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485893248:0@lo:400:kworker.0 00000100:00100000:3.0:1788463664.535068:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96189162aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485894144:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788463664.535682:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788463664.535689:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788463664.535703:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788463664.558294:0:20632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1875339485893504:12345-0@lo:38:kworker.0 Request processed in 40252us (40568us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788463664.558312:0:20632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1788463664.559106:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188cf2a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788463664.559113:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788463664.559118:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875339485893504:0@lo:38:kworker.0 00010000:00010000:3.0:1788463664.771678:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788463665.188407:0:20833:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788463665.207278:0:20833:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1788463665.207417:0:20833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bde800/0x841acb7f42a3aa04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aa0b expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463665.207432:0:20833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bde800/0x841acb7f42a3aa04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3aa0b expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463665.207440:0:20833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bde800/0x841acb7f42a3aa04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3aa0b expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463665.207448:0:20833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff961786bde800/0x841acb7f42a3aa04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3aa0b expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463665.207512:0:20833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788463665.207518:0:20833:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788463665.207562:0:20833:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788463665.207568:0:20833:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788463665.207603:0:20833:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788463665.207611:0:20833:0:(import.c:65:import_set_state_nolock()) ffff96188cf2a000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788463665.207616:0:20833:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788463665.207618:0:20833:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788463665.207621:0:20833:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788463665.208658:0:20833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdf800/0x841acb7f42a3a963 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a96a expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463665.208673:0:20833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdf800/0x841acb7f42a3a963 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3a96a expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463665.208680:0:20833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdf800/0x841acb7f42a3a963 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3a96a expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463665.208702:0:20833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff961786bdf800/0x841acb7f42a3a963 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3a96a expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463665.209411:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788463665.209420:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961786bde800/0x841acb7f42a3aa04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3aa0b expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463665.209428:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde800 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:2.0:1788463665.209432:0:17044:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961786bde800/0x841acb7f42a3aa04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3aa0b expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463665.209450:0:17044:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961786bde800/0x841acb7f42a3aa04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a3aa0b expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788463665.209458:0:17044:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961786bde800/0x841acb7f42a3aa04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a3aa0b expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463665.209464:0:17044:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788463665.209467:0:17044:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788463665.209469:0:17044:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788463665.209507:0:17044:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961786bde800/0x841acb7f42a3aa04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3aa0b expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463665.209513:0:17044:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788463665.209559:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961786bde800/0x841acb7f42a3aa04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3aa0b expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463665.209567:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961786bde800/0x841acb7f42a3aa04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3aa0b expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463665.209598:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463665.209602:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961786bdf800/0x841acb7f42a3a963 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3a96a expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463665.209608:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf800 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:2.0:1788463665.209611:0:17044:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961786bdf800/0x841acb7f42a3a963 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3a96a expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463665.209617:0:17044:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961786bdf800/0x841acb7f42a3a963 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a3a96a expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788463665.209633:0:17044:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961786bdf800/0x841acb7f42a3a963 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a3a96a expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463665.209639:0:17044:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788463665.209641:0:17044:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1788463665.209655:0:17044:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961786bdf800/0x841acb7f42a3a963 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3a96a expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463665.209660:0:17044:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788463665.209667:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961786bdf800/0x841acb7f42a3a963 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3a96a expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463665.209675:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463665.209676:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463665.209678:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463665.209698:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485894528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788463665.209761:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463665.209827:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788463665.209833:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485894400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788463665.209855:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463665.209885:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485894528 00000100:00100000:2.0:1788463665.209891:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485894528 00000100:00100000:2.0:1788463665.209922:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485894400 00000100:00100000:2.0:1788463665.209925:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485894400 00000100:00100000:2.0:1788463665.209942:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788463665.209949:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad768380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3651:x1875339485894528:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788463665.209955:0:17041:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788463665 with bad export cookie 9519144509840271407 00010000:00010000:1.0:1788463665.211189:0:20833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788463665.211200:0:20833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961786bdf800/0x841acb7f42a3a963 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3a96a expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463665.211222:0:20833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c1e27600/0x841acb7f42a3ac50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ac57 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463665.211230:0:20833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c1e27600/0x841acb7f42a3ac50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3ac57 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463665.211237:0:20833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c1e27600/0x841acb7f42a3ac50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3ac57 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463665.211244:0:20833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff9618c1e27600/0x841acb7f42a3ac50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3ac57 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463665.211263:0:20833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463665.211270:0:20833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0dc00/0x841acb7f42a3adfb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ae02 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463665.211276:0:20833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0dc00/0x841acb7f42a3adfb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3ae02 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463665.211391:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463665.211398:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff9618c1e27600/0x841acb7f42a3ac50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3ac57 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463665.211405:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e27600 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463665.211409:0:17045:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff9618c1e27600/0x841acb7f42a3ac50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3ac57 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463665.211417:0:17045:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff9618c1e27600/0x841acb7f42a3ac50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a3ac57 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463665.211442:0:17045:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff9618c1e27600/0x841acb7f42a3ac50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a3ac57 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463665.211447:0:17045:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788463665.211449:0:17045:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788463665.211452:0:17045:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788463665.211485:0:17045:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff9618c1e27600/0x841acb7f42a3ac50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3ac57 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463665.211490:0:17045:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463665.211510:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff9618c1e27600/0x841acb7f42a3ac50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3ac57 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463665.211517:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff9618c1e27600/0x841acb7f42a3ac50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3ac57 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463665.211545:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463665.211548:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463665.211549:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463665.211565:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961891628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61537c78-f571-4169-84d6-9d8a2058e62c:3648:1875339485894656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463665.211641:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788463665.211806:0:20833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0dc00/0x841acb7f42a3adfb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3ae02 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463665.211827:0:20833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff961787d0dc00/0x841acb7f42a3adfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3ae02 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463665.211846:0:20833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463665.211853:0:20833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a955 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a95c expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463665.211859:0:20833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a955 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3a95c expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463665.211865:0:20833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a955 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3a95c expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463665.211871:0:20833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a955 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3a95c expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463665.211878:0:20833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788463665.211881:0:20833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1788463665.211884:0:20833:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1788463665.211921:0:20833:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1788463665.211925:0:20833:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1788463665.211930:0:20833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788463665.211936:0:20833:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788463665.211941:0:20833:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff961787329800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788463665.211947:0:20833:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9617873e9000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788463665.211952:0:20833:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9618831e0000) has exports, disconnecting them 00000020:00080000:1.0:1788463665.211956:0:20833:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff961787329800), last request at 1788463664 00000020:00000080:1.0:1788463665.211963:0:20833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3ac42 00000100:00080000:1.0:1788463665.211984:0:20833:0:(import.c:65:import_set_state_nolock()) ffff961787328000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788463665.212027:0:20833:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff961787329800): rc 0 00000020:00000080:1.0:1788463665.212029:0:20833:0:(genops.c:885:class_export_put()) final put ffff961787329800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1788463665.212048:0:20833:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9617873e9000), last request at 1788463664 00000020:00000080:1.0:1788463665.212051:0:20833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3aae4 00000100:00080000:1.0:1788463665.212056:0:20833:0:(import.c:65:import_set_state_nolock()) ffff9617873ed000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788463665.212062:0:20833:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9617873e9000): rc 0 00000020:00000080:1.0:1788463665.212064:0:20833:0:(genops.c:885:class_export_put()) final put ffff9617873e9000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1788463665.212071:0:20833:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffba4741cebae0 00010000:00010000:0.0:1788463665.212161:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788463665.212166:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961787d0dc00/0x841acb7f42a3adfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3ae02 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463665.212172:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0dc00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463665.212175:0:17045:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961787d0dc00/0x841acb7f42a3adfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3ae02 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463665.212192:0:17045:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961787d0dc00/0x841acb7f42a3adfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a3ae02 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463665.212198:0:17045:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961787d0dc00/0x841acb7f42a3adfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a3ae02 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463665.212204:0:17045:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788463665.212206:0:17045:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788463665.212208:0:17045:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788463665.212226:0:17045:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961787d0dc00/0x841acb7f42a3adfb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3ae02 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463665.212233:0:17045:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463665.212246:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961787d0dc00/0x841acb7f42a3adfb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3ae02 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463665.212253:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961787d0dc00/0x841acb7f42a3adfb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3ae02 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463665.212262:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463665.212265:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a955 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3a95c expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463665.212271:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdea00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463665.212274:0:17045:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a955 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3a95c expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463665.212294:0:17045:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a955 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a3a95c expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463665.212311:0:17045:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a955 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a3a95c expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463665.212317:0:17045:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788463665.212318:0:17045:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788463665.212320:0:17045:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788463665.212349:0:17045:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a955 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3a95c expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463665.212355:0:17045:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463665.212371:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a955 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3a95c expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463665.212377:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a955 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3a95c expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463665.212390:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463665.212392:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463665.212393:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463665.212404:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96189162aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61537c78-f571-4169-84d6-9d8a2058e62c:3649:1875339485894784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463665.212439:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463665.212465:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfe8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61537c78-f571-4169-84d6-9d8a2058e62c:3650:1875339485894912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463665.212486:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463665.212718:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485894656 00000100:00100000:0.0:1788463665.212725:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485894656 00000100:00100000:0.0:1788463665.212750:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485894784 00000100:00100000:0.0:1788463665.212753:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485894784 00000100:00100000:0.0:1788463665.212760:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485894912 00000100:00100000:0.0:1788463665.212762:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485894912 00000100:00100000:0.0:1788463665.212781:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788463665.212802:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad769180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3651:x1875339485894400:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788463665.212808:0:17042:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788463665 with bad export cookie 9519144509840271407 00000100:00100000:0.0:1788463665.212858:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad769180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3651:x1875339485894400:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (3001us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788463665.212865:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788463665.212884:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788463665.212888:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3648:x1875339485894656:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788463665.212891:0:17042:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788463665 with bad export cookie 9519144509840271407 00000100:00100000:0.0:1788463665.212919:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3648:x1875339485894656:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (1279us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788463665.212924:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788463665.212937:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788463665.212940:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cfeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3649:x1875339485894784:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788463665.212944:0:17042:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788463665 with bad export cookie 9519144509840271407 00000100:00100000:0.0:1788463665.212970:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cfeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3649:x1875339485894784:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (531us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788463665.212975:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788463665.212987:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788463665.212990:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cfeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3650:x1875339485894912:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788463665.212993:0:17042:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788463665 with bad export cookie 9519144509840271407 00000100:00100000:0.0:1788463665.213019:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cfeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3650:x1875339485894912:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (532us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788463665.213023:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1788463665.213058:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.153@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788463665.213061:0:3650:0:(import.c:65:import_set_state_nolock()) ffff961786884800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788463665.213070:0:3650:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.153@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788463665.213207:0:20833:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788463665.213212:0:20833:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788463665.214058:0:20833:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788463665.214064:0:20833:0:(import.c:65:import_set_state_nolock()) ffff96189154e000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788463665.215937:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.153@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000020:00000080:3.0:1788463665.216012:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff961787329800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788463665.216064:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9617873e9000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788463665.216102:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961787328000 for lustre-MDT0001 00000020:00000080:3.0:1788463665.216106:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9617873ed000 for lustre-MDT0001 00010000:00010000:3.0:1788463665.217249:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463665.221541:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad768380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3651:x1875339485894528:12345-0@lo:103:ldlm_bl.0 Request processed in 11574us (11762us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788463665.221567:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788463665.222773:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.153@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788463665.222895:0:20833:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788463665.222901:0:20833:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1788463665.222914:0:20833:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788463665.222973:0:20833:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788463665.222998:0:20833:0:(import.c:65:import_set_state_nolock()) ffff961883731000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788463665.223013:0:20833:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788463665.223016:0:20833:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1788463665.223024:0:20833:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788463665.223098:0:20833:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788463665.223108:0:20833:0:(import.c:65:import_set_state_nolock()) ffff961891880800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788463665.223145:0:20833:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9618831e0000) has no exports 00000100:00100000:3.0:1788463665.235837:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485895040:0@lo:9:umount.0 00000100:00100000:3.0:1788463665.235926:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463665.235969:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485895168:0@lo:9:umount.0 00000100:00100000:3.0:1788463665.235990:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463665.236035:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485895040 00000100:00100000:3.0:1788463665.236043:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485895040 00000100:00100000:3.0:1788463665.236096:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485895168 00000100:00100000:3.0:1788463665.236100:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485895168 00000100:00100000:3.0:1788463665.236120:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788463665.236130:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875339485895040:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788463665.236156:0:18563:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3ab0e 00000100:00080000:3.0:1788463665.236167:0:18563:0:(import.c:65:import_set_state_nolock()) ffff961786a7a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788463665.236207:0:18563:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1788463665.236336:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3647:x1875339485895040:12345-0@lo:9:umount.0 Request processed in 207us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463665.236354:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788463665.236369:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788463665.236374:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875339485895168:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788463665.236384:0:18563:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3ac73 00000100:00080000:3.0:1788463665.236389:0:18563:0:(import.c:65:import_set_state_nolock()) ffff961786a7d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788463665.236410:0:18563:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788463665.236482:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3647:x1875339485895168:12345-0@lo:9:umount.0 Request processed in 108us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463665.236489:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:3.0:1788463665.236512:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788463665.236539:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961883731000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788463665.236564:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788463665.236566:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788463665.236571:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485895040:0@lo:9:umount.0 00000100:00080000:3.0:1788463665.236611:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961891880800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788463665.236619:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788463665.236621:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788463665.236624:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485895168:0@lo:9:umount.0 00000100:00080000:0.0:1788463665.240744:0:3650:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.153@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788463665.240750:0:3650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788463665.240759:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9618884f6680 x1875339485892992/t0(0) o400->MGC192.168.204.153@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788463680 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463665.240774:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9618ad76b480 x1875339485894528/t0(0) o103->MGC192.168.204.153@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788463681 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463665.240783:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9618ad76ad80 x1875339485894400/t0(0) o103->MGC192.168.204.153@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788463681 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463665.240804:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff961891628a80 x1875339485894656/t0(0) o103->MGC192.168.204.153@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788463681 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463665.240814:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff96189162aa00 x1875339485894784/t0(0) o103->MGC192.168.204.153@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788463681 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463665.240824:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff96188cfe8380 x1875339485894912/t0(0) o103->MGC192.168.204.153@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788463681 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788463665.240988:0:3649:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff961786884800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1788463665.241112:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96189162aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61537c78-f571-4169-84d6-9d8a2058e62c:3649:1875339485894784:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788463665.241247:0:3651:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff961786884800 already not connected (conn 1, was 1): DISCONN 10000000:01000000:0.0:1788463665.241378:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788463665.241381:0:3650:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788463665.241383:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788463665.241386:0:3650:0:(import.c:65:import_set_state_nolock()) ffff961786884800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788463665.241392:0:3650:0:(import.c:545:import_select_connection()) MGC192.168.204.153@tcp: connect to NID 0@lo last attempt 586 00000100:00080000:0.0:1788463665.241401:0:3650:0:(import.c:665:import_select_connection()) MGC192.168.204.153@tcp: import ffff961786884800 using connection 192.168.204.153@tcp/0@lo 00010000:00010000:0.0:1788463665.241412:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463665.241451:0:3650:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188cfead80 x1875339485895296/t0(0) o250->MGC192.168.204.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788463665.241492:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfe8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61537c78-f571-4169-84d6-9d8a2058e62c:3650:1875339485894912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463665.241720:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961891628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61537c78-f571-4169-84d6-9d8a2058e62c:3648:1875339485894656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463665.241746:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485894528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463665.241753:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485892992:0@lo:400:kworker.0 00000100:00100000:1.0:1788463665.241799:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485894400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788463665.241838:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:61537c78-f571-4169-84d6-9d8a2058e62c:3647:1875339485895296:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1788463665.241884:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875339485895296 offset 0 length 520: 4 00000020:00080000:3.0:1788463665.254490:0:20833:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9618831e0000) has no exports 00000020:01000000:2.0:1788463665.297781:0:20833:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff961891f40060 - data ffff96189972caf8/ffff9618ad754400 00000020:01000000:2.0:1788463665.298083:0:20833:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96188f6b42a0 - data ffff96188bd71360/ffff9618add0ac00 00000001:00000004:2.0:1788463665.316674:0:20833:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:0.0:1788463665.370998:0:20833:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788463665.371008:0:20833:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788463665.371025:0:20833:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788463665.375104:0:20833:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788463665.375114:0:20833:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1788463665.375128:0:20833:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788463665.375131:0:20833:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788463665.377261:0:17797:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788463665.377271:0:17797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:3.0:1788463665.377294:0:17797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1788463665.377931:0:20833:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788463665.377937:0:20833:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1788463665.378009:0:20833:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788463665.378012:0:20833:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788463665.390170:0:17799:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788463665.390179:0:17799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1788463665.390223:0:17799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788463665.391909:0:20833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a978 00000020:00000080:0.0:1788463665.391920:0:20833:0:(genops.c:885:class_export_put()) final put ffff9618b7cbc000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788463665.392552:0:20833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a98d 00000020:00000080:0.0:1788463665.392559:0:20833:0:(genops.c:885:class_export_put()) final put ffff96188cedd800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788463665.392564:0:20833:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1788463665.392569:0:20833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788463665.392663:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff9618b7cbc000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788463665.392681:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff96188cedd800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1788463665.392960:0:20833:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788463665.392966:0:20833:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9618831e4d40) has no exports 00000004:01000000:0.0:1788463665.393127:0:20833:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788463665.393135:0:20833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a9e1 00000020:00000080:0.0:1788463665.393140:0:20833:0:(genops.c:885:class_export_put()) final put ffff961883735800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788463665.393145:0:20833:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788463665.393150:0:20833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788463665.393154:0:20833:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788463665.393157:0:20833:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff96188d3a0000) has no exports 00000020:00000080:0.0:1788463665.393162:0:20833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a9da 00000020:00000080:0.0:1788463665.393165:0:20833:0:(genops.c:885:class_export_put()) final put ffff961883731800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1788463665.393480:0:20833:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788463665.393486:0:20833:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788463665.393490:0:20833:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1788463665.393495:0:20833:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788463665.393498:0:20833:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788463665.393524:0:20833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788463665.393537:0:20833:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788463665.393543:0:20833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a9cc 00000020:00000080:0.0:1788463665.393547:0:20833:0:(genops.c:885:class_export_put()) final put ffff961883733800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788463665.393552:0:20833:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788463665.393554:0:20833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788463665.393558:0:20833:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788463665.393560:0:20833:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff96188d3a4d40) has no exports 00000020:00000080:0.0:1788463665.393564:0:20833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a9be 00000020:00000080:0.0:1788463665.393566:0:20833:0:(genops.c:885:class_export_put()) final put ffff961891881800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1788463665.394045:0:20833:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788463665.394049:0:20833:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788463665.394051:0:20833:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1788463665.394055:0:20833:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788463665.394057:0:20833:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788463665.394062:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff961883735800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788463665.394132:0:20833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788463665.394138:0:20833:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1788463665.394146:0:20833:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788463665.394150:0:20833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a9b0 00000020:00000080:2.0:1788463665.394155:0:20833:0:(genops.c:885:class_export_put()) final put ffff961886ddf000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788463665.394182:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff961883731800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788463665.394191:0:1365:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961891880800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788463665.394197:0:1365:0:(genops.c:885:class_export_put()) final put ffff961883735000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788463665.394200:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff961883735000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788463665.394204:0:1365:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788463665.394295:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff961883733800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788463665.394303:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff961891881800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788463665.394308:0:1365:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961883731000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788463665.394312:0:1365:0:(genops.c:885:class_export_put()) final put ffff961885292800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788463665.394314:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff961885292800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788463665.394319:0:1365:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788463665.394493:0:20833:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1788463665.394500:0:20833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788463665.394505:0:20833:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788463665.394507:0:20833:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9618831e19c0) has no exports 00000020:00000080:2.0:1788463665.394513:0:20833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a9a9 00000020:00000080:2.0:1788463665.394516:0:20833:0:(genops.c:885:class_export_put()) final put ffff9618b7cbe000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788463665.394708:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff961886ddf000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788463665.394770:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9618b7cbe000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788463665.397663:0:20833:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1788463665.397672:0:20833:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788463665.397677:0:20833:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788463665.397685:0:20833:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788463665.397733:0:20833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788463665.397749:0:20833:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788463665.397808:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96189154e000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788463665.397818:0:36:0:(genops.c:885:class_export_put()) final put ffff96188f725800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788463665.397821:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96188f725800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1788463665.397829:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788463665.397947:0:20833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788463665.397951:0:20833:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788463665.397955:0:20833:0:(genops.c:885:class_export_put()) final put ffff9618b7cbb000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788463665.397957:0:20833:0:(genops.c:844:class_export_destroy()) destroying export ffff9618b7cbb000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1788463665.397961:0:20833:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788463665.398141:0:20833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a994 00000020:00000080:3.0:1788463665.398147:0:20833:0:(genops.c:885:class_export_put()) final put ffff96188ceda000/lustre-MDD0001_UUID 00000020:01000000:3.0:1788463665.398181:0:20833:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1788463665.398185:0:20833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788463665.398197:0:20833:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788463665.398201:0:20833:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9618831e3380) has no exports 00000020:00000080:3.0:1788463665.398220:0:20833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788463665.398223:0:20833:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1788463665.398227:0:20833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a99b 00000020:00000080:3.0:1788463665.398231:0:20833:0:(genops.c:885:class_export_put()) final put ffff961787d24800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788463665.398246:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96188ceda000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1788463665.398250:0:36:0:(genops.c:885:class_export_put()) final put ffff9618b7cbf800/lustre-MDD0001_UUID 00000020:00000080:0.0:1788463665.398252:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9618b7cbf800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1788463665.398255:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:01000004:3.0:1788463665.398391:0:20833:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96188cec8000 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1788463665.398394:0:20833:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96188cec8000 2 00000020:01000004:3.0:1788463665.398396:0:20833:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96188cec8000 from lustre-MDT0001 00000020:00000080:3.0:1788463665.398415:0:20833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788463665.398418:0:20833:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1788463665.398421:0:20833:0:(genops.c:885:class_export_put()) final put ffff9618b7cb9000/lustre-MDT0001_UUID 00000020:00000080:3.0:1788463665.398422:0:20833:0:(genops.c:844:class_export_destroy()) destroying export ffff9618b7cb9000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1788463665.398427:0:20833:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1788463665.398451:0:20833:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1788463665.398455:0:20833:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1788463665.398457:0:20833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788463665.398459:0:20833:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788463665.398465:0:20833:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9618adcbf800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788463665.398469:0:20833:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff96188d3a3380) has exports, disconnecting them 00000020:00080000:3.0:1788463665.398473:0:20833:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9618adcbf800), last request at 1788463562 00000020:00000080:3.0:1788463665.398477:0:20833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3aa19 00000020:00080000:3.0:1788463665.398486:0:20833:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9618adcbf800): rc 0 00000020:00000080:3.0:1788463665.398489:0:20833:0:(genops.c:885:class_export_put()) final put ffff9618adcbf800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788463665.398504:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff961787d24800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788463665.399465:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9618adcbf800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1788463665.401642:0:20833:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1788463665.401652:0:20833:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788463665.401656:0:20833:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788463665.401663:0:20833:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788463665.401720:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96188cf2a000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788463665.401878:0:20833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788463665.401888:0:20833:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1788463665.401899:0:20833:0:(genops.c:885:class_export_put()) final put ffff96188cf2f800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1788463665.401903:0:20833:0:(genops.c:844:class_export_destroy()) destroying export ffff96188cf2f800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1788463665.401912:0:20833:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1788463665.401980:0:20833:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96188cec8000 1 00000020:00000080:2.0:1788463665.401985:0:20833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a940 00000020:00000080:2.0:1788463665.401991:0:20833:0:(genops.c:885:class_export_put()) final put ffff96188cecf000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1788463665.402045:0:20833:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1788463665.402050:0:20833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788463665.402055:0:20833:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788463665.402059:0:20833:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff961787c9cd40) has no exports 00000020:00000080:0.0:1788463665.403892:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96188cecf000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788463665.432337:0:20833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788463665.432351:0:20833:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1788463665.432357:0:20833:0:(genops.c:885:class_export_put()) final put ffff96188cec9800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788463665.432362:0:20833:0:(genops.c:844:class_export_destroy()) destroying export ffff96188cec9800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788463665.432376:0:20833:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1788463665.432491:0:20833:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff96188cec8800 00000020:01000000:3.0:1788463665.432512:0:20833:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788463665.432525:0:20833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788463665.432530:0:20833:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788463665.432534:0:20833:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff96188f9bcd40) has no exports 00000100:00100000:1.0:1788463665.432819:0:18932:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9617810a2800:18932] 3 exiting: rc = 0 00000100:00100000:3.0:1788463665.432841:0:17056:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff961889e80a00:17056] 0 exiting: rc = 1 00000100:00100000:0.0:1788463665.432941:0:17057:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff96188cffe200:17057] 1 exiting: rc = 0 00000100:00100000:2.0:1788463665.433302:0:17058:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff96188cffe000:17058] 2 exiting: rc = 0 00000100:00100000:2.0:1788463665.433372:0:20632:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9618ae1d6200:20632] 4 exiting: rc = 0 00000100:00100000:3.0:1788463665.433523:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433529:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433532:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433536:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433540:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433544:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433547:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433551:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433555:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433558:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433562:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433566:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433569:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433640:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433648:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433654:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433660:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433666:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433672:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433679:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433685:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433690:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433696:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433701:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433706:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433711:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433716:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433720:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433726:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433733:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433739:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433758:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433763:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433769:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433775:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433791:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433798:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433804:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433809:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433816:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433822:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433827:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433833:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433839:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433846:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433851:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433856:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433862:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433867:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433872:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433876:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433882:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433887:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433892:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433897:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433902:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433908:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433913:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433918:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433924:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433929:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433935:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433940:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.433946:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.439008:0:17060:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff961788580a00:17060] 1 exiting: rc = 0 00000100:00100000:2.0:1788463665.439263:0:17059:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff96188cfff400:17059] 0 exiting: rc = 1 00000100:00100000:3.0:1788463665.439465:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439474:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439494:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439501:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439506:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439510:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439516:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439522:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439527:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439532:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439536:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439541:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439545:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439550:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439554:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439559:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439563:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439568:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439603:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439611:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439617:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439623:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439628:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439634:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439639:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439645:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439650:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439656:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439660:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439665:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439670:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439674:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439679:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439683:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439688:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439693:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439698:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439711:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439717:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439722:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439732:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439737:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439743:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439748:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439752:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439758:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439763:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439768:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439773:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439778:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439792:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439799:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439806:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439813:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439820:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439825:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439831:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439836:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439842:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439847:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439853:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439859:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439864:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.439870:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.441532:0:17061:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff96188cfffa00:17061] 0 exiting: rc = 1 00000100:00100000:2.0:1788463665.441533:0:18953:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff961788649200:18953] 2 exiting: rc = 0 00000100:00100000:1.0:1788463665.441653:0:17062:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff961788581e00:17062] 1 exiting: rc = 0 00000100:00100000:1.0:1788463665.444802:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.444818:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.444829:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.444848:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.444853:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.444923:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.444936:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.444946:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.444959:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.444965:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.444971:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.444977:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.444982:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445002:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445008:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445014:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445019:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445025:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445030:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445036:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445042:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445047:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445053:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445059:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445065:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445083:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445090:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445096:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445102:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445109:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445115:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445121:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445210:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445225:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445236:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445247:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445258:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445284:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445297:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445303:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445309:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445315:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445321:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445327:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445333:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445339:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445345:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445350:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445356:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445378:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445388:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445396:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445522:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445531:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445537:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445544:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445549:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445555:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445561:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445568:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445592:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445599:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445605:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.445619:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463665.456669:0:17063:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff961788580c00:17063] 0 exiting: rc = 1 00000100:00100000:2.0:1788463665.456904:0:17064:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff961788580800:17064] 1 exiting: rc = 0 00000100:00100000:1.0:1788463665.457004:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457011:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457017:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457022:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457028:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457033:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457038:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457043:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457049:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457071:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457076:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457081:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457086:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457090:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457093:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457096:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457100:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457104:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457107:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457110:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457113:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457115:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457118:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457121:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457124:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457128:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457133:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457138:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457142:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457146:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457150:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457154:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457158:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457163:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457168:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457172:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457177:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457182:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457187:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457193:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457198:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457203:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457208:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457213:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457229:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457233:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457238:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457243:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457248:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457254:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457258:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457263:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457268:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457273:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457278:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457282:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457286:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457290:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457293:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457296:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457299:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457303:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457306:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.457309:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463665.457974:0:17065:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff961788581200:17065] 0 exiting: rc = 1 00000100:00100000:3.0:1788463665.458320:0:17066:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff961884333600:17066] 1 exiting: rc = 0 00000100:00100000:1.0:1788463665.458377:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458509:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458517:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458523:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458528:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458533:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458539:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458544:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458549:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458554:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458559:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458564:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458569:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458604:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458610:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458626:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458636:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458641:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458646:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458653:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458659:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458665:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458671:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458676:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458681:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458686:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458691:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458696:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458701:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458706:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458712:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458717:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458721:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458725:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458730:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458736:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458742:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458747:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458752:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458758:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458763:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458768:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458774:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458779:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458798:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458803:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458808:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458814:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458820:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458825:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458836:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458841:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458846:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458852:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458858:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458862:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458868:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458872:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458877:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458882:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458887:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458892:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458896:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.458901:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.459306:0:17068:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff961884332000:17068] 1 exiting: rc = 0 00000100:00100000:0.0:1788463665.459507:0:17067:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff961884332600:17067] 0 exiting: rc = 1 00000100:00100000:1.0:1788463665.459791:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459799:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459805:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459811:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459816:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459821:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459827:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459832:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459838:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459844:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459849:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459854:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459860:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459865:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459870:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459875:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459881:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459885:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459892:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459898:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459903:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459918:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459924:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459929:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459935:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459940:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459945:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459950:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459954:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459959:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459965:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459971:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459976:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.459996:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460001:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460006:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460012:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460017:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460022:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460028:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460032:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460038:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460046:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460052:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460057:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460062:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460067:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460073:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460077:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460083:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460087:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460093:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460098:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460104:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460110:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460116:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460129:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460134:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460140:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460145:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460150:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460155:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460160:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463665.460165:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.461197:0:17069:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9618988e7a00:17069] 0 exiting: rc = 1 00000100:00100000:1.0:1788463665.461498:0:17071:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9618988e7c00:17071] 2 exiting: rc = 0 00000100:00100000:2.0:1788463665.462220:0:17070:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9618988e7400:17070] 1 exiting: rc = 0 00000100:00100000:2.0:1788463665.462307:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462315:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462320:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462326:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462331:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462336:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462342:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462347:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462353:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462371:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462378:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462393:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462410:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462416:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462421:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462427:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462432:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462438:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462444:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462449:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462454:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462460:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462465:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462470:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462476:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462481:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462486:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462492:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462498:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462503:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462509:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462515:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462521:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462540:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462547:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462553:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462558:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462564:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462570:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462667:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462673:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462679:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462684:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462691:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462696:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462700:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462713:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462719:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462724:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462730:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462735:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462742:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462747:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462752:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462758:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462764:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462770:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462775:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462789:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462796:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462801:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462807:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462813:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463665.462825:0:20833:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788463665.467150:0:20833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788463665.467166:0:20833:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788463665.467173:0:20833:0:(genops.c:885:class_export_put()) final put ffff96188f727000/MDS_uuid 00000020:00000080:3.0:1788463665.467178:0:20833:0:(genops.c:844:class_export_destroy()) destroying export ffff96188f727000/MDS_uuid for MDS 00000020:01000000:3.0:1788463665.467183:0:20833:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788463665.467338:0:20833:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1788463665.795815:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463666.820141:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463667.845228:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463668.871709:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788463669.639469:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) 61537c78-f571-4169-84d6-9d8a2058e62c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788463669.639480:0:1365:0:(pinger.c:247:ptlrpc_pinger_process_import()) 61537c78-f571-4169-84d6-9d8a2058e62c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788463669.639483:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788463669.639487:0:1365:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788463669.639491:0:1365:0:(import.c:65:import_set_state_nolock()) ffff9617873b8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788463669.639500:0:1365:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 703 00000100:00080000:1.0:1788463669.639507:0:1365:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788463669.639515:0:1365:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9617873b8000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:1.0:1788463669.639553:0:1365:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188d1d2300 x1875339485895424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788463669.639621:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788463669.639625:0:1365:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788463669.639627:0:1365:0:(import.c:65:import_set_state_nolock()) ffff96178732a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788463669.639631:0:1365:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 703 00000100:00080000:1.0:1788463669.639633:0:1365:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788463669.639636:0:1365:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96178732a800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:1.0:1788463669.639648:0:1365:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188d1d3800 x1875339485895680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788463669.639694:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463669.639721:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485895552:0@lo:400:kworker.0 00000400:00000100:1.0:1788463669.639772:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875339485895552 offset 0 length 224: 4 00000100:00100000:1.0:1788463669.639823:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485895808:0@lo:400:kworker.0 00000400:00000100:1.0:1788463669.639841:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875339485895808 offset 0 length 224: 4 00000100:00100000:2.0:1788463669.639965:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875339485895424:0@lo:38:kworker.0 00000400:00000100:2.0:1788463669.639988:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875339485895424 offset 0 length 520: 4 00000100:00100000:2.0:1788463669.640003:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875339485895680:0@lo:38:kworker.0 00000400:00000100:2.0:1788463669.640017:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875339485895680 offset 0 length 520: 4 00000020:01000004:0.0:1788463669.652974:0:21034:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788463669.671269:0:21034:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788463669.671325:0:21034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc1a00/0x841acb7f42a3aab3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aaba expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463669.671340:0:21034:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc1a00/0x841acb7f42a3aab3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3aaba expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463669.671348:0:21034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc1a00/0x841acb7f42a3aab3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3aaba expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463669.671377:0:21034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff961787bc1a00/0x841acb7f42a3aab3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3aaba expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463669.671403:0:21034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788463669.671412:0:21034:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788463669.671438:0:21034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788463669.671449:0:21034:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff96188d1d2300 x1875339485895424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788463689 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463669.671471:0:21034:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788463669.671478:0:21034:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788463669.671485:0:21034:0:(import.c:65:import_set_state_nolock()) ffff9617873b8000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788463669.671491:0:21034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788463669.671494:0:21034:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff96188d1d2300 x1875339485895424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788463689 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463669.671501:0:21034:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788463669.671504:0:21034:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 26s for inflight to error out 00000100:00100000:0.0:1788463669.671648:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875339485895424:0@lo:38:kworker.0 00010000:00010000:3.0:1788463669.671873:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463669.671882:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961787bc1a00/0x841acb7f42a3aab3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3aaba expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463669.671890:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1a00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:3.0:1788463669.671894:0:17044:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961787bc1a00/0x841acb7f42a3aab3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3aaba expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463669.671902:0:17044:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961787bc1a00/0x841acb7f42a3aab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a3aaba expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463669.671909:0:17044:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961787bc1a00/0x841acb7f42a3aab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a3aaba expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463669.671914:0:17044:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788463669.671917:0:17044:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788463669.671919:0:17044:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788463669.671932:0:17044:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff961786884800 00010000:00010000:3.0:1788463669.671936:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961787bc1a00/0x841acb7f42a3aab3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x841acb7f42a3aaba expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463669.671943:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961787bc1a00/0x841acb7f42a3aab3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x841acb7f42a3aaba expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463669.671953:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463669.671955:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463669.671956:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788463669.673635:0:21034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788463669.673652:0:21034:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff96188d1d2680 x1875339485895552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463685 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463669.673733:0:21034:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788463669.673739:0:21034:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788463669.673763:0:21034:0:(import.c:65:import_set_state_nolock()) ffff96178689f800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788463669.674314:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875339485895936:0@lo:39:umount.0 00000400:00000100:0.0:1788463669.674381:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875339485895936 offset 0 length 224: 4 00000100:00100000:1.0:1788463669.674426:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485895552:0@lo:400:kworker.0 00010000:00010000:1.0:1788463669.891828:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788463670.662217:0:18558:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788463670.662225:0:18558:0:(genops.c:885:class_export_put()) final put ffff961786a7e800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788463670.662344:0:19378:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788463670.662348:0:19378:0:(genops.c:885:class_export_put()) final put ffff961786a7c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788463670.662379:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff961786a7e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788463670.662428:0:1365:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961786a7a800 for lustre-OST0000 00000020:00000080:1.0:1788463670.662548:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff961786a7c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788463670.662724:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961786a7d000 for lustre-OST0001 00010000:00010000:3.0:1788463670.916800:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463671.940667:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463672.964467:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463673.994017:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788463674.756107:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 61537c78-f571-4169-84d6-9d8a2058e62c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788463674.756118:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 61537c78-f571-4169-84d6-9d8a2058e62c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788463674.756121:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788463674.756124:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788463674.756273:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485896064:0@lo:400:kworker.0 00000400:00000100:0.0:1788463674.756330:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875339485896064 offset 0 length 224: 4 00010000:00010000:3.0:1788463675.012676:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463675.843754:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463665/real 1788463665] req@ffff96188cfead80 x1875339485895296/t0(0) o250->MGC192.168.204.153@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788463675 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463675.843791:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96188cfead80 x1875339485895296/t0(0) o250->MGC192.168.204.153@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788463675 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788463675.843811:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961786884800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788463675.843841:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788463675.843846:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:61537c78-f571-4169-84d6-9d8a2058e62c:3647:1875339485895296:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:3.0:1788463675.846334:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 61537c78-f571-4169-84d6-9d8a2058e62c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788463675.846344:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788463675.846348:0:36:0:(import.c:65:import_set_state_nolock()) ffff961786884800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788463675.846356:0:36:0:(import.c:545:import_select_connection()) MGC192.168.204.153@tcp: connect to NID 0@lo last attempt 704 00000100:00080000:3.0:1788463675.846361:0:36:0:(import.c:630:import_select_connection()) MGC192.168.204.153@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788463675.846369:0:36:0:(import.c:665:import_select_connection()) MGC192.168.204.153@tcp: import ffff961786884800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463675.846408:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9618884f5500 x1875339485896192/t0(0) o250->MGC192.168.204.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788463675.846438:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788463675.846443:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788463675.846559:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:61537c78-f571-4169-84d6-9d8a2058e62c:3647:1875339485896192:0@lo:250:kworker.0 00000100:00100000:1.0:1788463675.846630:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485896320:0@lo:400:kworker.0 00000400:00000100:1.0:1788463675.846666:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875339485896320 offset 0 length 224: 4 00000400:00000100:0.0:1788463675.846798:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875339485896192 offset 0 length 520: 4 00010000:00010000:1.0:1788463676.036986:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463677.060000:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463678.090493:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463679.108550:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463679.939791:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463669/real 1788463669] req@ffff9618ad769180 x1875339485895936/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788463679 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463679.939826:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9618ad769180 x1875339485895936/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788463679 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788463679.939846:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96178689f800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788463679.939874:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875339485895936:0@lo:39:umount.0 00000100:00080000:2.0:1788463679.939980:0:21034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788463679.939986:0:21034:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788463679.940006:0:21034:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788463679.943029:0:21034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c1e26600/0x841acb7f42a3aa89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aa90 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463679.943049:0:21034:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c1e26600/0x841acb7f42a3aa89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3aa90 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463679.943057:0:21034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c1e26600/0x841acb7f42a3aa89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3aa90 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463679.943065:0:21034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff9618c1e26600/0x841acb7f42a3aa89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3aa90 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463679.943241:0:21034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788463679.943250:0:21034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0c400/0x841acb7f42a3aded lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3adf4 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463679.943258:0:21034:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0c400/0x841acb7f42a3aded lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3adf4 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463679.943265:0:21034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0c400/0x841acb7f42a3aded lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3adf4 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463679.943271:0:21034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff961787d0c400/0x841acb7f42a3aded lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3adf4 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463679.944618:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788463679.944630:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff9618c1e26600/0x841acb7f42a3aa89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3aa90 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463679.944640:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26600 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:1.0:1788463679.944645:0:17045:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff9618c1e26600/0x841acb7f42a3aa89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3aa90 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463679.944654:0:17045:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff9618c1e26600/0x841acb7f42a3aa89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a3aa90 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463679.944678:0:17045:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff9618c1e26600/0x841acb7f42a3aa89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a3aa90 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463679.944684:0:17045:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788463679.944687:0:17045:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1788463679.944699:0:17045:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff961786884800 00010000:00010000:1.0:1788463679.944702:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff9618c1e26600/0x841acb7f42a3aa89 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x841acb7f42a3aa90 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463679.944709:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff9618c1e26600/0x841acb7f42a3aa89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x841acb7f42a3aa90 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463679.944725:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463679.944729:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961787d0c400/0x841acb7f42a3aded lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3adf4 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463679.944735:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0c400 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:1.0:1788463679.944738:0:17045:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961787d0c400/0x841acb7f42a3aded lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3adf4 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463679.944744:0:17045:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961787d0c400/0x841acb7f42a3aded lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a3adf4 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463679.944750:0:17045:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961787d0c400/0x841acb7f42a3aded lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a3adf4 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463679.944755:0:17045:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788463679.944756:0:17045:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788463679.944760:0:17045:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff961786884800 00010000:00010000:1.0:1788463679.944766:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961787d0c400/0x841acb7f42a3aded lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x841acb7f42a3adf4 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463679.944773:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463679.944774:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463679.944776:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463679.945077:0:21034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788463679.945085:0:21034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961787d0c400/0x841acb7f42a3aded lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x841acb7f42a3adf4 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463679.945097:0:21034:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788463679.945105:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788463679.945109:0:21034:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1788463679.945112:0:21034:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788463679.945143:0:21034:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788463679.945146:0:21034:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788463679.945152:0:21034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788463679.945157:0:21034:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788463679.945161:0:21034:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9618916599c0) has no exports 00000020:00080000:2.0:1788463679.945183:0:21034:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9618916599c0) has no exports 00000020:01000000:2.0:1788463679.948548:0:21034:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff961891f40540 - data ffff96188bc3e288/ffff9618ad756400 00000020:01000000:2.0:1788463679.948688:0:21034:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff961787363f00 - data ffff96188bf41bd0/ffff961898005c00 00100000:10000000:3.0:1788463679.960374:0:21034:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788463679.979657:0:21034:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3aa9e 00000020:00000080:2.0:1788463679.979681:0:21034:0:(genops.c:885:class_export_put()) final put ffff961883732000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788463679.979700:0:21034:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96188cf2e800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788463679.979704:0:21034:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96188cf2e800 2 00000020:01000004:2.0:1788463679.979708:0:21034:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96188cf2e800 from lustre-OST0000 00000020:00000080:2.0:1788463679.979731:0:21034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788463679.979741:0:21034:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788463679.979744:0:21034:0:(genops.c:885:class_export_put()) final put ffff9618adcbe800/lustre-OST0000_UUID 00000020:00000080:2.0:1788463679.979747:0:21034:0:(genops.c:844:class_export_destroy()) destroying export ffff9618adcbe800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788463679.979754:0:21034:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788463679.979839:0:21034:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788463679.979843:0:21034:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788463679.979847:0:21034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788463679.979852:0:21034:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788463679.979858:0:21034:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff96178689d000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788463679.979864:0:21034:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff961787c9b380) has exports, disconnecting them 00000020:00080000:2.0:1788463679.979869:0:21034:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff96178689d000), last request at 1788463579 00000020:00000080:2.0:1788463679.979873:0:21034:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3aac8 00000020:00080000:2.0:1788463679.979884:0:21034:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96178689d000): rc 0 00000020:00000080:2.0:1788463679.979887:0:21034:0:(genops.c:885:class_export_put()) final put ffff96178689d000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788463679.979978:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff961883732000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788463679.979997:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96178689d000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788463679.988343:0:21034:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788463679.988354:0:21034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788463679.988359:0:21034:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788463679.988389:0:21034:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788463679.988571:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9617873b8000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788463679.988878:0:21034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788463679.988888:0:21034:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788463679.988893:0:21034:0:(genops.c:885:class_export_put()) final put ffff9617873bc800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788463679.988898:0:21034:0:(genops.c:844:class_export_destroy()) destroying export ffff9617873bc800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788463679.988908:0:21034:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788463679.988973:0:21034:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788463679.988977:0:21034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788463679.988982:0:21034:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788463679.988988:0:21034:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9617873bb800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788463679.988994:0:21034:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff9617871e99c0) has exports, disconnecting them 00000020:00080000:0.0:1788463679.988999:0:21034:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9617873bb800), last request at 1788463579 00000020:00000080:0.0:1788463679.989003:0:21034:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3aadd 00000020:00080000:0.0:1788463679.989016:0:21034:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9617873bb800): rc 0 00000020:00000080:0.0:1788463679.989021:0:21034:0:(genops.c:885:class_export_put()) final put ffff9617873bb800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788463679.989180:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9617873bb800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788463679.995064:0:21034:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788463679.995075:0:21034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788463679.995079:0:21034:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788463679.995087:0:21034:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788463679.996533:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96178689f800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788463680.000758:0:21034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788463680.000774:0:21034:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788463680.000780:0:21034:0:(genops.c:885:class_export_put()) final put ffff96178689c800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788463680.000784:0:21034:0:(genops.c:844:class_export_destroy()) destroying export ffff96178689c800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788463680.002205:0:21034:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788463680.002283:0:21034:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96188cf2e800 1 00000020:00000080:1.0:1788463680.002291:0:21034:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3aa7b 00000020:00000080:1.0:1788463680.002299:0:21034:0:(genops.c:885:class_export_put()) final put ffff96188d10b000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788463680.002316:0:21034:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788463680.002333:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96188d10b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788463680.002346:0:21034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788463680.002352:0:21034:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788463680.002356:0:21034:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff961787c999c0) has no exports 00000020:00000080:2.0:1788463680.036918:0:21034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788463680.036942:0:21034:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788463680.036947:0:21034:0:(genops.c:885:class_export_put()) final put ffff96188ceca000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788463680.036952:0:21034:0:(genops.c:844:class_export_destroy()) destroying export ffff96188ceca000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788463680.036961:0:21034:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788463680.037948:0:21034:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff96188cf2e000 00000020:02000400:2.0:1788463680.037993:0:21034:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788463680.137269:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788463680.900664:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 61537c78-f571-4169-84d6-9d8a2058e62c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788463680.900686:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 61537c78-f571-4169-84d6-9d8a2058e62c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788463680.900689:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788463680.900694:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788463680.900800:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463680.900823:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485896448:0@lo:400:kworker.0 00000400:00000100:0.0:1788463680.900900:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875339485896448 offset 0 length 224: 4 00010000:00010000:3.0:1788463681.156716:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463682.180922:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463683.204206:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788463684.018411:0:21238:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788463684.034196:0:21238:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788463684.034286:0:21238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc1600/0x841acb7f42a3ac11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ac18 expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463684.034316:0:21238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc1600/0x841acb7f42a3ac11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3ac18 expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463684.034324:0:21238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc1600/0x841acb7f42a3ac11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3ac18 expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463684.034332:0:21238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff961787bc1600/0x841acb7f42a3ac11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3ac18 expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463684.034363:0:21238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788463684.034369:0:21238:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788463684.034392:0:21238:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788463684.034403:0:21238:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff96188d1d3800 x1875339485895680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788463689 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463684.034430:0:21238:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788463684.034470:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96178732a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788463684.034503:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:3.0:1788463684.034508:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875339485895680:0@lo:38:kworker.0 00000100:00080000:3.0:1788463684.034535:0:21238:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788463684.034540:0:21238:0:(import.c:65:import_set_state_nolock()) ffff96178732a800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788463684.034544:0:21238:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788463684.034546:0:21238:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788463684.034549:0:21238:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788463684.035266:0:21238:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788463684.035275:0:21238:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff96188d1d0380 x1875339485895808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463685 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463684.035294:0:21238:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9618884f4700 x1875339485896064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463690 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463684.035324:0:21238:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9618884f4000 x1875339485896320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463691 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463684.035336:0:21238:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff96188d1d2680 x1875339485896448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463696 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463684.035342:0:21238:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788463684.035346:0:21238:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788463684.035366:0:21238:0:(import.c:65:import_set_state_nolock()) ffff961786a7e000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788463684.035396:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875339485896576:0@lo:39:umount.0 00000400:00000100:3.0:1788463684.035468:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875339485896576 offset 0 length 224: 4 00010000:00010000:2.0:1788463684.035601:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463684.035609:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961787bc1600/0x841acb7f42a3ac11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3ac18 expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463684.035618:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1600 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:2.0:1788463684.035622:0:17045:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961787bc1600/0x841acb7f42a3ac11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3ac18 expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463684.035633:0:17045:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961787bc1600/0x841acb7f42a3ac11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a3ac18 expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788463684.035640:0:17045:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961787bc1600/0x841acb7f42a3ac11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a3ac18 expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463684.035645:0:17045:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788463684.035648:0:17045:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788463684.035650:0:17045:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788463684.035664:0:17045:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff961786884800 00010000:00010000:2.0:1788463684.035667:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961787bc1600/0x841acb7f42a3ac11 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x841acb7f42a3ac18 expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463684.035674:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961787bc1600/0x841acb7f42a3ac11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x841acb7f42a3ac18 expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463684.035686:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463684.035696:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463684.035698:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463684.036116:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485896064:0@lo:400:kworker.0 00000100:00100000:0.0:1788463684.036145:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485896448:0@lo:400:kworker.0 00000100:00100000:0.0:1788463684.036153:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485896320:0@lo:400:kworker.0 00000100:00080000:0.0:1788463684.036289:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) 61537c78-f571-4169-84d6-9d8a2058e62c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788463684.036295:0:1365:0:(pinger.c:247:ptlrpc_pinger_process_import()) 61537c78-f571-4169-84d6-9d8a2058e62c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788463684.036331:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485895808:0@lo:400:kworker.0 00010000:00010000:3.0:1788463684.227854:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463685.256620:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463686.276523:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463687.302705:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463688.324407:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788463689.098917:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 61537c78-f571-4169-84d6-9d8a2058e62c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788463689.098928:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 61537c78-f571-4169-84d6-9d8a2058e62c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788463689.352877:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463690.180557:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463675/real 1788463675] req@ffff9618884f5500 x1875339485896192/t0(0) o250->MGC192.168.204.153@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788463690 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463690.180616:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9618884f5500 x1875339485896192/t0(0) o250->MGC192.168.204.153@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788463690 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788463690.180637:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961786884800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788463690.180665:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788463690.180668:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:61537c78-f571-4169-84d6-9d8a2058e62c:3647:1875339485896192:0@lo:250:kworker.0 00000100:00080000:1.0:1788463690.182433:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 61537c78-f571-4169-84d6-9d8a2058e62c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788463690.182441:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788463690.182445:0:8:0:(import.c:65:import_set_state_nolock()) ffff961786884800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788463690.182453:0:8:0:(import.c:545:import_select_connection()) MGC192.168.204.153@tcp: connect to NID 0@lo last attempt 715 00000100:00080000:1.0:1788463690.182459:0:8:0:(import.c:630:import_select_connection()) MGC192.168.204.153@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788463690.182466:0:8:0:(import.c:665:import_select_connection()) MGC192.168.204.153@tcp: import ffff961786884800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:1.0:1788463690.182502:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188d1d0380 x1875339485896704/t0(0) o250->MGC192.168.204.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788463690.182733:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:61537c78-f571-4169-84d6-9d8a2058e62c:3647:1875339485896704:0@lo:250:kworker.0 00000400:00000100:3.0:1788463690.182795:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875339485896704 offset 0 length 520: 4 00010000:00010000:3.0:1788463690.372648:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463691.400683:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463692.421022:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463693.450920:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463694.277153:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463684/real 1788463684] req@ffff9618884f7480 x1875339485896576/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788463694 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463694.277235:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9618884f7480 x1875339485896576/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788463694 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788463694.277262:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961786a7e000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788463694.277290:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875339485896576:0@lo:39:umount.0 00000100:00080000:2.0:1788463694.277423:0:21238:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788463694.277429:0:21238:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788463694.277435:0:21238:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788463694.278410:0:21238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c1e26200/0x841acb7f42a3abe7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3abee expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463694.278429:0:21238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c1e26200/0x841acb7f42a3abe7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3abee expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463694.278438:0:21238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c1e26200/0x841acb7f42a3abe7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3abee expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463694.278446:0:21238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff9618c1e26200/0x841acb7f42a3abe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3abee expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463694.278479:0:21238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788463694.278489:0:21238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882813a00/0x841acb7f42a3addf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ade6 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463694.278497:0:21238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882813a00/0x841acb7f42a3addf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3ade6 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463694.278503:0:21238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882813a00/0x841acb7f42a3addf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3ade6 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463694.278527:0:21238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff961882813a00/0x841acb7f42a3addf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3ade6 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463694.278551:0:21238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788463694.278557:0:21238:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788463694.278631:0:21238:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788463694.278636:0:21238:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788463694.278642:0:21238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788463694.278649:0:21238:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788463694.278655:0:21238:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9617871eb380) has no exports 00000020:00080000:2.0:1788463694.278687:0:21238:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9617871eb380) has no exports 00010000:00010000:0.0:1788463694.280631:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788463694.280649:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff9618c1e26200/0x841acb7f42a3abe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3abee expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463694.280664:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26200 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463694.280670:0:17045:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff9618c1e26200/0x841acb7f42a3abe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3abee expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463694.280682:0:17045:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff9618c1e26200/0x841acb7f42a3abe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a3abee expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463694.280691:0:17045:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff9618c1e26200/0x841acb7f42a3abe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a3abee expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463694.280697:0:17045:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788463694.280700:0:17045:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1788463694.280704:0:17045:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788463694.280731:0:17045:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff961786884800 00010000:00010000:0.0:1788463694.280736:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff9618c1e26200/0x841acb7f42a3abe7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x841acb7f42a3abee expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463694.280743:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff9618c1e26200/0x841acb7f42a3abe7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x841acb7f42a3abee expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463694.280773:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463694.280777:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961882813a00/0x841acb7f42a3addf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3ade6 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463694.280784:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813a00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463694.280810:0:17045:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961882813a00/0x841acb7f42a3addf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3ade6 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463694.280818:0:17045:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961882813a00/0x841acb7f42a3addf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a3ade6 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463694.280824:0:17045:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961882813a00/0x841acb7f42a3addf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a3ade6 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463694.280830:0:17045:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788463694.280832:0:17045:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788463694.280834:0:17045:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788463694.280841:0:17045:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff961786884800 00010000:00010000:0.0:1788463694.280844:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961882813a00/0x841acb7f42a3addf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x841acb7f42a3ade6 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463694.280850:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961882813a00/0x841acb7f42a3addf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x841acb7f42a3ade6 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463694.280868:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463694.280870:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463694.280871:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463694.281054:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788463694.285108:0:21238:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff961785f6e4e0 - data ffff96188be2c000/ffff9618bf4fb000 00000020:01000000:2.0:1788463694.285282:0:21238:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9618850f5540 - data ffff96188bda91b0/ffff96178731ec00 00100000:10000000:0.0:1788463694.297664:0:21238:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788463694.333098:0:21238:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3abfc 00000020:00000080:3.0:1788463694.333117:0:21238:0:(genops.c:885:class_export_put()) final put ffff9617885be800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788463694.333143:0:21238:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9617873bb000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788463694.333148:0:21238:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9617873bb000 2 00000020:01000004:3.0:1788463694.333151:0:21238:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9617873bb000 from lustre-OST0001 00000020:00000080:3.0:1788463694.333186:0:21238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788463694.333201:0:21238:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788463694.333204:0:21238:0:(genops.c:885:class_export_put()) final put ffff9617885bc800/lustre-OST0001_UUID 00000020:00000080:3.0:1788463694.333208:0:21238:0:(genops.c:844:class_export_destroy()) destroying export ffff9617885bc800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788463694.333217:0:21238:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788463694.333377:0:21238:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 61537c78-f571-4169-84d6-9d8a2058e62c->MGS 00010000:00010000:3.0:1788463694.333402:0:21238:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961786bdfc00/0x841acb7f42a3a947 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a3a94e expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463694.333417:0:21238:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961786bdfc00/0x841acb7f42a3a947 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a3a94e expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463694.333426:0:21238:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788463694.333429:0:21238:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788463694.333434:0:21238:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788463694.333456:0:21238:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff961786884800 00010000:00010000:3.0:1788463694.333461:0:21238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961786bdfc00/0x841acb7f42a3a947 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x841acb7f42a3a94e expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463694.333497:0:21238:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961787bc1400/0x841acb7f42a3a836 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a3a83d expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463694.333505:0:21238:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961787bc1400/0x841acb7f42a3a836 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a3a83d expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463694.333511:0:21238:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788463694.333513:0:21238:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788463694.333515:0:21238:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788463694.333527:0:21238:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff961786884800 00010000:00010000:3.0:1788463694.333529:0:21238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961787bc1400/0x841acb7f42a3a836 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x841acb7f42a3a83d expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788463694.333548:0:21238:0:(import.c:65:import_set_state_nolock()) ffff961786884800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788463694.333552:0:21238:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788463694.333555:0:21238:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788463694.333557:0:21238:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788463694.333562:0:21238:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788463694.333614:0:21238:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff96188d1d0380 x1875339485896704/t0(0) o250->MGC192.168.204.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788463710 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788463694.333632:0:21238:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788463694.333635:0:21238:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:0.0:1788463694.333874:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:61537c78-f571-4169-84d6-9d8a2058e62c:3647:1875339485896704:0@lo:250:kworker.0 00000020:00000080:2.0:1788463694.334524:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9617885be800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:3.0:1788463694.335081:0:21238:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788463694.335095:0:21238:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3a821 00000020:00000080:3.0:1788463694.335105:0:21238:0:(genops.c:885:class_export_put()) final put ffff96188f720800/61537c78-f571-4169-84d6-9d8a2058e62c 00000020:01000000:3.0:1788463694.335118:0:21238:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.153@tcp (flags='') 00000020:00000080:3.0:1788463694.335130:0:21238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788463694.335139:0:21238:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.153@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788463694.335144:0:21238:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff96188fbd3380) has no exports 00000020:00000080:2.0:1788463694.335232:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96188f720800/61537c78-f571-4169-84d6-9d8a2058e62c for MGC192.168.204.153@tcp 10000000:01000000:0.0:1788463694.341214:0:17054:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788463694.341621:0:21238:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.153@tcp: client import never connected 00000100:00080000:3.0:1788463694.341646:0:21238:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788463694.341651:0:21238:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788463694.341657:0:21238:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788463694.341661:0:21238:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788463694.341754:0:21238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788463694.341776:0:21238:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.153@tcp (uuid 61537c78-f571-4169-84d6-9d8a2058e62c) 00000020:01000000:3.0:1788463694.341787:0:21238:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788463694.341794:0:21238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788463694.341800:0:21238:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788463694.341812:0:21238:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff96178732b800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788463694.341820:0:21238:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff96178878cd40) has exports, disconnecting them 00000020:00080000:3.0:1788463694.341825:0:21238:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff96178732b800), last request at 1788463598 00000020:00000080:3.0:1788463694.341831:0:21238:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3ac26 00000020:00080000:3.0:1788463694.341852:0:21238:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96178732b800): rc 0 00000020:00000080:3.0:1788463694.341858:0:21238:0:(genops.c:885:class_export_put()) final put ffff96178732b800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788463694.342620:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961786884800 for MGC192.168.204.153@tcp 00000020:00000080:2.0:1788463694.342633:0:8:0:(genops.c:885:class_export_put()) final put ffff961786883000/61537c78-f571-4169-84d6-9d8a2058e62c 00000020:00000080:2.0:1788463694.342637:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff961786883000/61537c78-f571-4169-84d6-9d8a2058e62c for MGC192.168.204.153@tcp 00000020:01000000:2.0:1788463694.342645:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.153@tcp (61537c78-f571-4169-84d6-9d8a2058e62c) 00000020:00000080:2.0:1788463694.342979:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96178732b800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788463694.345067:0:21238:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788463694.345075:0:21238:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788463694.345080:0:21238:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788463694.345087:0:21238:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788463694.345372:0:21238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788463694.345384:0:21238:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1788463694.345392:0:21238:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788463694.345400:0:21238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788463694.345405:0:21238:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788463694.345414:0:21238:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff961786a79000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788463694.345422:0:21238:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff96188fbd0000) has exports, disconnecting them 00000020:00080000:3.0:1788463694.345427:0:21238:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff961786a79000), last request at 1788463598 00000020:00000080:3.0:1788463694.345432:0:21238:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3ac3b 00000020:00080000:3.0:1788463694.345451:0:21238:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff961786a79000): rc 0 00000020:00000080:3.0:1788463694.345471:0:21238:0:(genops.c:885:class_export_put()) final put ffff961786a79000/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1788463694.347236:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96178732a800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788463694.347259:0:8:0:(genops.c:885:class_export_put()) final put ffff961785e70000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788463694.347263:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff961785e70000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788463694.347283:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788463694.347397:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff961786a79000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1788463694.363389:0:21238:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788463694.363401:0:21238:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788463694.363406:0:21238:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788463694.363415:0:21238:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788463694.363456:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961786a7e000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1788463694.363532:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788463694.370108:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:1.0:1788463694.374403:0:17040:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff96178709bc00:17040] 1 exiting: rc = 0 00000100:00100000:3.0:1788463694.375738:0:18209:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff961787d8a400:18209] 2 exiting: rc = 0 00000100:00100000:0.0:1788463694.441497:0:17039:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff96178709b800:17039] 0 exiting: rc = 1 00000100:00100000:0.0:1788463694.441692:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.441703:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.442067:0:20084:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff96188cf73400:20084] 3 exiting: rc = 0 00000100:00100000:0.0:1788463694.442153:0:17043:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff96178709a400:17043] 2 exiting: rc = 0 00000100:00100000:0.0:1788463694.442211:0:17042:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff96178709be00:17042] 1 exiting: rc = 0 00000100:00100000:2.0:1788463694.443161:0:17041:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff96178709a200:17041] 0 exiting: rc = 1 00000100:00100000:0.0:1788463694.443328:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.443337:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.443343:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.443351:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.443357:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.443364:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.443371:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.443376:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.443505:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.443514:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.443519:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.443525:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.443531:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.443537:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.443543:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.443548:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.443553:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.443557:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.443563:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.443567:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.443588:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444056:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444061:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444067:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444072:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444078:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444084:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444089:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444094:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444100:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444106:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444111:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444117:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444122:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444128:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444134:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444140:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444145:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444151:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444155:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444161:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444170:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444175:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444181:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444186:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444191:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444196:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444202:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444233:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444241:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444324:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444334:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444341:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444347:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444354:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444359:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444374:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.444380:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.445532:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.445541:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.445547:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.445553:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.445558:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.445564:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788463694.447503:0:21238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788463694.447518:0:21238:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1788463694.447526:0:21238:0:(genops.c:885:class_export_put()) final put ffff961786a7b800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1788463694.447532:0:21238:0:(genops.c:844:class_export_destroy()) destroying export ffff961786a7b800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1788463694.447539:0:21238:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1788463694.447644:0:21238:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9617873bb000 1 00000020:00000080:0.0:1788463694.447654:0:21238:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3abe0 00000020:00000080:0.0:1788463694.447661:0:21238:0:(genops.c:885:class_export_put()) final put ffff9617873e9800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788463694.447679:0:21238:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788463694.447693:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9617873e9800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788463694.447707:0:21238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788463694.447712:0:21238:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788463694.447716:0:21238:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff961788788000) has no exports 00000020:00000080:0.0:1788463694.555687:0:21238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788463694.555712:0:21238:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788463694.555722:0:21238:0:(genops.c:885:class_export_put()) final put ffff96188d10f800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788463694.555728:0:21238:0:(genops.c:844:class_export_destroy()) destroying export ffff96188d10f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788463694.555746:0:21238:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788463694.557225:0:21238:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff96188f410800 00000020:01000000:0.0:1788463694.557288:0:21238:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788463694.557297:0:21238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788463694.557304:0:21238:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788463694.557310:0:21238:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff96188fbd19c0) has no exports 00000020:00000080:0.0:1788463694.557336:0:21238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788463694.557360:0:21238:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788463694.557364:0:21238:0:(genops.c:885:class_export_put()) final put ffff96188d108000/OSS_uuid 00000020:00000080:0.0:1788463694.557369:0:21238:0:(genops.c:844:class_export_destroy()) destroying export ffff96188d108000/OSS_uuid for OSS 00000020:01000000:0.0:1788463694.557375:0:21238:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1788463694.557889:0:18933:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9617870d2600:18933] 3 exiting: rc = 0 00000100:00080000:2.0:1788463694.558029:0:17052:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788463694.558071:0:18562:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff96188d31f800:18562] 0 exiting: rc = 1 00000100:00100000:3.0:1788463694.558154:0:18564:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff96188d0f4c00:18564] 2 exiting: rc = 0 00000100:00100000:3.0:1788463694.558244:0:18563:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9617878f4c00:18563] 1 exiting: rc = 0 00000100:00100000:0.0:1788463694.559467:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559480:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559487:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559494:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559499:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559506:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559513:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559518:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559524:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559531:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559538:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559545:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559551:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559557:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559563:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559569:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559593:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559611:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559620:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559627:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559632:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559638:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559644:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559649:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559654:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559659:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559665:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559670:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559676:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559682:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559689:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559725:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559733:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.559739:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.560696:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.560702:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.560708:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.560723:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.560730:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.560736:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.560742:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.560747:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.560923:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.560931:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.560937:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.560943:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.560949:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.560955:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.560960:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.560967:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.560974:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.560980:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.560986:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.560992:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.560997:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.561003:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.561009:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.561015:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.561021:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.561026:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.561032:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.561038:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.561044:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.561049:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463694.565856:0:18565:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff96188f40a800:18565] 0 exiting: rc = 1 00000100:00100000:0.0:1788463694.565856:0:20398:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff961786b00e00:20398] 2 exiting: rc = 0 00000100:00100000:2.0:1788463694.565870:0:18566:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9618a5f8c600:18566] 1 exiting: rc = 0 00000100:00100000:0.0:1788463694.569402:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569438:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569444:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569450:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569457:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569463:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569469:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569476:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569482:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569489:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569495:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569502:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569508:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569514:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569520:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569526:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569532:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569538:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569545:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569550:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569555:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569561:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569593:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569643:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569651:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569657:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569662:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569668:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569674:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569680:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569686:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569692:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569698:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569705:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569710:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569716:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569728:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569734:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569740:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569747:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569929:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569939:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569944:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569951:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569956:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569961:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569967:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569972:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569977:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569982:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569988:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569994:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.569999:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.570005:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.570011:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.570018:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.570024:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.570029:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.570036:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.570043:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.570049:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.570056:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.570062:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.570068:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463694.574513:0:18568:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9618ad5e7400:18568] 1 exiting: rc = 0 00000100:00100000:2.0:1788463694.575414:0:18567:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9618ad5e7600:18567] 0 exiting: rc = 1 00000100:00100000:2.0:1788463694.576083:0:18569:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9618ad7c4200:18569] 2 exiting: rc = 0 00000100:00100000:0.0:1788463694.576277:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576288:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576294:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576301:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576307:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576337:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576346:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576367:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576373:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576380:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576387:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576396:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576404:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576412:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576419:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576425:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576432:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576439:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576445:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576451:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576459:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576466:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576472:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576479:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576485:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576492:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576498:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576505:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576511:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576533:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576541:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576547:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576554:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576560:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576853:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576863:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576871:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576878:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576889:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576895:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576905:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576913:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576930:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576938:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576947:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576954:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576961:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576969:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576976:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576984:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576991:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.576998:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.577006:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.577013:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.577020:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.577040:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.577057:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.577074:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.577081:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.577088:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.577093:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.577099:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.577105:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.577111:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.593915:0:18571:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9618ad7c4400:18571] 1 exiting: rc = 0 00000100:00100000:3.0:1788463694.594175:0:18570:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff96188f57bc00:18570] 0 exiting: rc = 1 00000100:00100000:0.0:1788463694.594426:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594435:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594441:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594447:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594453:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594459:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594465:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594470:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594483:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594491:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594496:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594502:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594508:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594528:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594534:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594541:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594547:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594553:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594559:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594564:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594569:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594602:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594609:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594615:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594620:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594628:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594634:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594639:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594645:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594652:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594657:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594664:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594670:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594676:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594682:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594688:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594693:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594699:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594705:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594711:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594717:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594724:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594729:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594734:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594740:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594745:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594890:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594899:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594912:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594918:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594924:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594930:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594936:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594942:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594948:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594954:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594960:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594966:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594973:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594979:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594985:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594991:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.594997:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463694.595009:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.600693:0:18572:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff96188f57ba00:18572] 0 exiting: rc = 1 00000100:00100000:3.0:1788463694.607347:0:18573:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff96188f57be00:18573] 1 exiting: rc = 0 00000100:00100000:2.0:1788463694.609551:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609592:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609602:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609611:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609618:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609627:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609657:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609664:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609671:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609678:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609685:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609692:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609698:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609705:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609712:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609718:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609725:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609732:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609770:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609779:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609786:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609795:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609802:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609810:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609817:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609825:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609831:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609837:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609843:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609850:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609870:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609878:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609884:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609890:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609898:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609919:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609926:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609933:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609941:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609952:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609959:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609965:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609987:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.609996:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.610002:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.610010:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.610016:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.610024:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.610031:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.610041:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.610049:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.610058:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.610066:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.610073:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.610097:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.610105:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.610113:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.610120:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.610127:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.610134:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.610140:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.610147:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.610155:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463694.610162:0:21238:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788463694.633505:0:21238:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788463718.769027:0:22004:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg453-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788463731.545064:0:22604:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788463731.545071:0:22604:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788463731.545073:0:22604:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788463731.545406:0:22604:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9618bf5d9000 00000020:01000004:2.0:1788463731.545423:0:22604:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788463731.545430:0:22604:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788463731.545454:0:22604:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9617871e8000) 00000020:00000080:2.0:1788463731.545469:0:22604:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788463731.637053:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788463731.644666:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788463731.651609:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788463731.653019:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788463731.653534:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788463731.653759:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788463731.653994:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788463731.654229:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788463731.654604:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788463731.654880:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788463731.655126:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788463731.655422:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788463731.655651:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788463731.655900:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788463731.656098:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788463731.656680:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788463731.656938:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788463731.657122:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788463731.657528:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788463731.658454:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788463731.658748:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788463731.659005:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788463731.659241:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788463731.659487:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788463731.659733:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788463731.660040:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788463731.660250:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788463731.660511:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788463731.660731:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788463731.661571:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788463731.662056:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788463731.662302:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788463731.662545:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788463731.662875:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788463731.663136:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788463731.663445:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788463731.663678:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788463731.663929:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788463731.664129:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788463731.664384:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788463731.664623:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788463731.665154:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788463731.665696:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788463731.665958:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788463731.666194:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788463731.666613:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788463731.666916:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788463731.667362:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1788463731.671053:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1788463731.671451:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1788463731.675058:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1788463731.676250:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1788463731.676956:0:22604:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:0.0:1788463731.678024:0:22604:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788463731.678245:0:22604:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788463731.678253:0:22604:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788463731.678275:0:22604:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x841acb7f42a3b127 00000020:01000004:0.0:1788463731.678283:0:22604:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788463731.678288:0:22604:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788463731.678294:0:22604:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9618bf5d9000 from MGS 00000020:01000004:0.0:1788463731.678298:0:22604:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788463731.678309:0:22604:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff96188fbd0000) 00000020:00000080:0.0:1788463731.678319:0:22604:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788463731.678378:0:22604:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9618bf5d9000 from MGS, refs=2 00080000:01000000:0.0:1788463731.678383:0:22604:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788463731.678396:0:22604:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x841acb7f42a3b135 00000100:00100000:0.0:1788463731.678488:0:22604:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788463731.678653:0:22604:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788463731.678659:0:22604:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788463731.681828:0:22604:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788463731.681840:0:22604:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788463731.682716:0:22604:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788463731.683043:0:22604:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788463731.683050:0:22604:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788463731.687678:0:22604:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788463731.687700:0:22604:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788463731.688329:0:22604:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788463731.688336:0:22604:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788463731.689237:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463731.689240:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463731.689243:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463731.689614:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463731.689616:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463731.689618:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463731.690309:0:22604:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788463731.691993:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788463731.701466:0:22604:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788463731.702700:0:22617:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788463731.702752:0:22604:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788463731.702802:0:22604:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788463731.707783:0:22604:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788463731.708124:0:22604:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788463731.709401:0:22604:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788463731.709413:0:22604:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788463731.718062:0:22604:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788463731.718075:0:22604:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788463731.719610:0:22604:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788463731.719622:0:22604:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788463731.729732:0:22604:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788463731.729760:0:22604:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.153@tcp' 00000020:01000004:3.0:1788463731.729762:0:22604:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:2.0:1788463731.729912:0:22622:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:3.0:1788463731.730051:0:22604:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.153@tcp (typ=mgc) 00000020:00000080:3.0:1788463731.730065:0:22604:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.153@tcp (ffff9617887899c0) 00000020:00000080:3.0:1788463731.730081:0:22604:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788463731.730715:0:22604:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96188f726000@MGC192.168.204.153@tcp: add connection 192.168.204.153@tcp at head 00010000:00010000:3.0:1788463731.732002:0:22604:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.153@tcp-0 is initialized 00000040:01000000:3.0:1788463731.732014:0:22604:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.153@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788463731.735076:0:22623:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788463731.735183:0:22604:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.153@tcp (uuid abd83a7b-f7e3-4d68-aade-6298a66ab956) 00000020:00000080:2.0:1788463731.735210:0:22604:0:(genops.c:1385:class_connect()) connect: client abd83a7b-f7e3-4d68-aade-6298a66ab956, cookie 0x841acb7f42a3b143 00000100:00080000:2.0:1788463731.735223:0:22604:0:(import.c:545:import_select_connection()) MGC192.168.204.153@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788463731.735229:0:22604:0:(import.c:665:import_select_connection()) MGC192.168.204.153@tcp: import ffff96188f726000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:2.0:1788463731.735275:0:22604:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9618ad768380 x1875339485896832/t0(0) o250->MGC192.168.204.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788463731.735306:0:22604:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import abd83a7b-f7e3-4d68-aade-6298a66ab956->MGS 00000020:01000004:2.0:1788463731.735329:0:22604:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788463731.735334:0:22604:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788463731.735350:0:22604:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9617871ecd40) 00000020:00000080:2.0:1788463731.735361:0:22604:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788463731.735538:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:abd83a7b-f7e3-4d68-aade-6298a66ab956:3647:1875339485896832:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788463731.735622:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463731.735690:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485896832 00000100:00100000:3.0:1788463731.735712:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485896832 00000100:00100000:3.0:1788463731.735744:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788463731.735751:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3647:x1875339485896832:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788463731.735773:0:22618:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from abd83a7b-f7e3-4d68-aade-6298a66ab956@0@lo t0 exp 0000000000000000 cur 771 last 0 00000020:00000080:3.0:1788463731.735809:0:22618:0:(genops.c:1385:class_connect()) connect: client abd83a7b-f7e3-4d68-aade-6298a66ab956, cookie 0x841acb7f42a3b151 00000100:00080000:3.0:1788463731.735960:0:22618:0:(import.c:65:import_set_state_nolock()) ffff96188f726800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788463731.736012:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+5:3647:x1875339485896832:12345-0@lo:250:mount.lustre.0 Request processed in 260us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463731.736019:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788463731.736060:0:3647:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.153@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788463731.736068:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.204.153@tcp: connect to target with instance 0 00000100:00080000:3.0:1788463731.736074:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.204.153@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788463731.736078:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788463731.736082:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188f726000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788463731.736084:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788463731.736091:0:3647:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788463731.736096:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:abd83a7b-f7e3-4d68-aade-6298a66ab956:3647:1875339485896832:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788463731.772720:0:22604:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788463731.775526:0:22604:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788463731.775541:0:22604:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788463731.787272:0:22604:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788463731.787292:0:22604:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788463731.789380:0:22604:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788463731.789391:0:22604:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788463731.790076:0:22604:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788463731.790244:0:22604:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788463731.790254:0:22604:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788463731.791289:0:22604:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788463731.791301:0:22604:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788463731.869438:0:22604:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788463731.869694:0:22604:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788463731.869702:0:22604:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788463731.873665:0:22604:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788463731.873683:0:22604:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788463731.874558:0:22604:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788463731.874770:0:22604:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788463731.874776:0:22604:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788463731.875821:0:22604:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788463731.875830:0:22604:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788463731.877243:0:22604:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788463731.877611:0:22604:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788463731.877617:0:22604:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788463731.878443:0:22604:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788463731.878451:0:22604:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788463731.883741:0:22604:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788463731.883951:0:22604:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788463731.883957:0:22604:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788463731.885852:0:22604:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788463731.885862:0:22604:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788463731.924528:0:22604:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788463731.924786:0:22604:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788463731.924793:0:22604:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788463731.928389:0:22604:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788463731.928405:0:22604:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788463731.930511:0:22604:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788463731.930526:0:22604:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788463731.931720:0:22604:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788463731.931758:0:22604:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788463731.931764:0:22604:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.153@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788463731.932357:0:22604:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.153@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788463731.932394:0:22604:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.153@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788463731.932399:0:22604:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788463731.932401:0:22604:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788463731.932406:0:22604:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788463731.932407:0:22604:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788463731.932409:0:22604:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788463731.932410:0:22604:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788463731.932411:0:22604:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788463731.932412:0:22604:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788463731.932414:0:22604:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788463731.932415:0:22604:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788463731.932418:0:22604:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788463731.932420:0:22604:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788463731.932421:0:22604:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788463731.932422:0:22604:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788463731.932423:0:22604:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788463731.932424:0:22604:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788463731.932425:0:22604:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788463731.932426:0:22604:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788463731.932427:0:22604:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788463731.932428:0:22604:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788463731.932428:0:22604:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788463731.932464:0:22604:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788463731.932486:0:22604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfeaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485896960:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788463731.932614:0:22604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463731.932760:0:22604:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188d09d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463731.936912:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485896960 00000100:00100000:3.0:1788463731.936927:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485896960 00000100:00100000:3.0:1788463731.937032:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788463731.937044:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f943850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+5:22604:x1875339485896960:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788463731.937113:0:22621:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788463731.937117:0:22621:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788463731.937119:0:22621:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788463731.937604:0:22642:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788463731.938249:0:22621:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1788463731.942520:0:22643:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788463731.942530:0:22643:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788463731.942533:0:22643:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788463731.942536:0:22643:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788463731.942884:0:22643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788463731.943290:0:22621:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788463731.943301:0:22621:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788463731.949679:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f943850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+5:22604:x1875339485896960:12345-0@lo:253:mount.lustre.0 Request processed in 12625us (17053us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463731.949700:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788463731.949773:0:22604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfeaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485896960:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788463731.949802:0:22604:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788463731.949807:0:22604:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788463731.949809:0:22604:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788463731.949810:0:22604:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788463731.949811:0:22604:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788463731.949812:0:22604:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788463731.949814:0:22604:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788463731.949815:0:22604:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788463731.949816:0:22604:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788463731.949818:0:22604:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788463731.949820:0:22604:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788463731.949843:0:22604:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9618bf5d9000 from lustre-MDT0000 10000000:01000000:0.0:1788463731.949879:0:22604:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788463731.949894:0:22604:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788463731.949899:0:22604:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9617887899c0 10000000:01000000:0.0:1788463731.949904:0:22604:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788463731.949914:0:22604:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9617887899c0 from 1 10000000:01000000:0.0:1788463731.949917:0:22604:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788463731.949969:0:22604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5e00/0x841acb7f42a3b158 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463731.949988:0:22604:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff96188f6f5e00/0x841acb7f42a3b158 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463731.949998:0:22604:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff96188f6f5e00/0x841acb7f42a3b158 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463731.950019:0:22604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfeaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485897088:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788463731.950060:0:22604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463731.950105:0:22604:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188d09df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788463731.950433:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485897088 00000100:00100000:3.0:1788463731.950441:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485897088 00000100:00100000:3.0:1788463731.950479:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788463731.950501:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f943450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+5:22604:x1875339485897088:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463731.950517:0:22620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463731.950534:0:22620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618be00e600/0x841acb7f42a3b15f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b158 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463731.950560:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618be00e600/0x841acb7f42a3b15f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b158 expref: 6 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463731.950571:0:22620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618be00e600/0x841acb7f42a3b15f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b158 expref: 6 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463731.950604:0:22620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618be00e600, rc 0) 00000100:00100000:0.0:1788463731.953308:0:22604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfeaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485897088:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788463731.953340:0:22604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff96188f6f5e00/0x841acb7f42a3b158 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b15f expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463731.953353:0:22604:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff96188f6f5e00/0x841acb7f42a3b158 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b15f expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463731.953426:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f943450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+6:22604:x1875339485897088:12345-0@lo:101:mount.lustre.0 Request processed in 2935us (3362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463731.953436:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788463731.953526:0:22604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485897216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463731.953594:0:22604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463731.953631:0:22604:0:(client.c:2716:ptlrpc_set_wait()) set ffff961898941cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463731.953749:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485897216 00000100:00100000:3.0:1788463731.953757:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485897216 00000100:00100000:3.0:1788463731.953803:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788463731.953811:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+6:22604:x1875339485897216:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463731.953887:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+6:22604:x1875339485897216:12345-0@lo:501:mount.lustre.0 Request processed in 77us (294us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788463731.953894:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788463731.953946:0:22604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485897216:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788463731.953976:0:22604:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788463731.953995:0:22604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5e00/0x841acb7f42a3b158 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b15f expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463731.954005:0:22604:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff96188f6f5e00/0x841acb7f42a3b158 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b15f expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463731.954014:0:22604:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9618bf5d9000 10000000:01000000:1.0:1788463731.954019:0:22604:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788463731.954023:0:22604:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9618bf5d9000 10000000:01000000:1.0:1788463731.954026:0:22604:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788463731.954029:0:22604:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9618bf5d9000 from 1 10000000:01000000:1.0:1788463731.954032:0:22604:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788463731.954056:0:22604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdfa00/0x841acb7f42a3b166 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463731.954064:0:22604:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961786bdfa00/0x841acb7f42a3b166 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463731.954092:0:22604:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961786bdfa00/0x841acb7f42a3b166 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463731.954104:0:22604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485897344:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788463731.954142:0:22604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463731.954172:0:22604:0:(client.c:2716:ptlrpc_set_wait()) set ffff961898941cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463731.954310:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485897344 00000100:00100000:0.0:1788463731.954315:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485897344 00000100:00100000:0.0:1788463731.954344:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788463731.954350:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+6:22604:x1875339485897344:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788463731.954359:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463731.955716:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96188f6f4800/0x841acb7f42a3b16d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b166 expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463731.955746:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96188f6f4800/0x841acb7f42a3b16d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b166 expref: 7 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463731.955758:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96188f6f4800/0x841acb7f42a3b16d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b166 expref: 7 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463731.955768:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f4800, rc 0) 00000100:00100000:0.0:1788463731.955840:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+7:22604:x1875339485897344:12345-0@lo:101:mount.lustre.0 Request processed in 1489us (1696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463731.955847:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788463731.956125:0:22604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485897344:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463731.956144:0:22604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961786bdfa00/0x841acb7f42a3b166 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b16d expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463731.957096:0:22604:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961786bdfa00/0x841acb7f42a3b166 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b16d expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463731.957117:0:22604:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788463731.957194:0:22604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdfa00/0x841acb7f42a3b166 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b16d expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463731.957202:0:22604:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961786bdfa00/0x841acb7f42a3b166 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b16d expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463731.957210:0:22604:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788463731.957216:0:22604:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788463731.957222:0:22604:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9618bf5d9000 10000000:01000000:3.0:1788463731.957234:0:22604:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788463731.957238:0:22604:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788463731.957240:0:22604:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788463731.957275:0:22604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618be00e800/0x841acb7f42a3b174 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463731.957282:0:22604:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff9618be00e800/0x841acb7f42a3b174 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463731.957292:0:22604:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff9618be00e800/0x841acb7f42a3b174 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463731.957311:0:22604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485897472:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788463731.957364:0:22604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463731.957400:0:22604:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618830b86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463731.957487:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485897472 00000100:00100000:0.0:1788463731.957507:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485897472 00000100:00100000:3.0:1788463731.958872:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788463731.958885:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+7:22604:x1875339485897472:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463731.958902:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463731.958918:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618be00f400/0x841acb7f42a3b17b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b174 expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463731.958943:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618be00f400/0x841acb7f42a3b17b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b174 expref: 8 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463731.958967:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618be00f400/0x841acb7f42a3b17b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b174 expref: 8 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463731.958976:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618be00f400, rc 0) 00000100:00100000:3.0:1788463731.959046:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+8:22604:x1875339485897472:12345-0@lo:101:mount.lustre.0 Request processed in 164us (1681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463731.959052:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788463731.959462:0:22604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485897472:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788463731.959481:0:22604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff9618be00e800/0x841acb7f42a3b174 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b17b expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463731.959500:0:22604:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff9618be00e800/0x841acb7f42a3b174 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b17b expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463731.959619:0:22604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad768380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485897600:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463731.959664:0:22604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463731.960009:0:22604:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b7c20840 going to sleep for 11 seconds 00000100:00100000:1.0:1788463731.960424:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485897600 00000100:00100000:1.0:1788463731.960432:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485897600 00000100:00100000:1.0:1788463731.960468:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788463731.960476:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+8:22604:x1875339485897600:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463731.960748:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+9:22604:x1875339485897600:12345-0@lo:501:mount.lustre.0 Request processed in 272us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463731.960756:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788463731.960930:0:22604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad768380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485897600:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463731.961328:0:22604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad768380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485897728:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788463731.961377:0:22604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463731.961417:0:22604:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b7c20840 going to sleep for 11 seconds 00000100:00100000:1.0:1788463731.961545:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485897728 00000100:00100000:1.0:1788463731.961550:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485897728 00000100:00100000:1.0:1788463731.961594:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788463731.961603:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+9:22604:x1875339485897728:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788463731.962772:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+9:22604:x1875339485897728:12345-0@lo:503:mount.lustre.0 Request processed in 1166us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463731.962792:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788463731.962940:0:22604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad768380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485897728:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788463731.963442:0:22644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad768380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:abd83a7b-f7e3-4d68-aade-6298a66ab956:22644:1875339485897856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463731.963488:0:22644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463731.963536:0:22644:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b7c20780 going to sleep for 11 seconds 00000100:00100000:3.0:1788463731.964648:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485897856 00000100:00100000:3.0:1788463731.964660:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485897856 00000100:00100000:3.0:1788463731.964705:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788463731.964715:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+9:22644:x1875339485897856:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788463731.965647:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+9:22644:x1875339485897856:12345-0@lo:502:llog_process_th.0 Request processed in 927us (2153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463731.965658:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788463731.965792:0:22644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad768380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:abd83a7b-f7e3-4d68-aade-6298a66ab956:22644:1875339485897856:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788463731.965830:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463731.965843:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463731.965845:0:22644:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788463731.965851:0:22644:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788463731.965860:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788463731.965878:0:22644:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9617871eb380) 00000020:00000080:2.0:1788463731.965897:0:22644:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788463731.965904:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788463731.966003:0:22644:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788463731.966011:0:22644:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x841acb7f42a3b189 00000020:00000080:2.0:1788463731.966480:0:22644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788463731.966499:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463731.966504:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463731.966505:0:22644:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788463731.966509:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463731.966512:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463731.966514:0:22644:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788463731.966517:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788463731.966525:0:22644:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9617871e99c0) 00000020:00000080:2.0:1788463731.966537:0:22644:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788463731.966542:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788463731.966544:0:22644:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788463731.966547:0:22644:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788463731.966553:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788463731.966647:0:22644:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9618bf5d9000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788463731.966659:0:22644:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff96188d3a3380) 00000020:00000080:2.0:1788463731.966666:0:22644:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788463731.966729:0:22644:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788463731.966736:0:22644:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x841acb7f42a3b19e 00000020:00000080:2.0:1788463731.967072:0:22644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788463731.967080:0:22644:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788463731.967085:0:22644:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x841acb7f42a3b1a5 00080000:01000000:2.0:1788463731.967090:0:22644:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788463731.967093:0:22644:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x841acb7f42a3b1ac 00010000:00010000:3.0:1788463732.065850:0:22644:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788463732.066511:0:22644:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934638 00000001:00080000:3.0:1788463732.068212:0:22644:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788463732.068753:0:22644:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff96178878b380) 00000020:00000080:3.0:1788463732.068777:0:22644:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788463732.068866:0:22644:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788463732.068874:0:22644:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x841acb7f42a3b1ba 00000020:00000080:2.0:1788463732.070826:0:22644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788463732.079123:0:22644:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x841acb7f42a3b1c1 00000020:00000080:3.0:1788463732.079527:0:22644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788463732.079541:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463732.079547:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463732.079550:0:22644:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788463732.079554:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788463732.079557:0:22644:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788463732.079559:0:22644:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788463732.079560:0:22644:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788463732.079562:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788463732.079564:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463732.079565:0:22644:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788463732.079568:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463732.079604:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463732.079606:0:22644:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788463732.079611:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788463732.079662:0:22644:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788463732.079680:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463732.079683:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463732.079684:0:22644:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788463732.079687:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463732.079689:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463732.079690:0:22644:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788463732.079693:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788463732.079698:0:22644:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.153@tcp to nid 0x20000c0a8cc99 (192.168.204.153@tcp) 00000020:00000080:3.0:1788463732.079726:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788463732.079742:0:22644:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff961788788000) 00000020:00000080:3.0:1788463732.079756:0:22644:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788463732.079761:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788463732.079844:0:22644:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788463732.079851:0:22644:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788463732.079857:0:22644:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x841acb7f42a3b1cf 00010000:00080000:3.0:1788463732.079889:0:22644:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9618850d2000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.153@tcp at head 00010000:00010000:3.0:1788463732.087005:0:22644:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1788463732.093423:0:22644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788463732.093441:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788463732.093484:0:22644:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788463732.093519:0:22644:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x841acb7f42a3b1d6 00000100:00080000:3.0:1788463732.093532:0:22644:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788463732.093539:0:22644:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9618850d2000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463732.093606:0:22644:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9618884f5500 x1875339485897984/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788463732.093639:0:22644:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1788463732.093697:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463732.093701:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463732.093703:0:22644:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788463732.093705:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788463732.093709:0:22644:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1788463732.093710:0:22644:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788463732.093712:0:22644:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788463732.093713:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788463732.093715:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463732.093717:0:22644:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788463732.093719:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788463732.093725:0:22644:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788463732.093728:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463732.093729:0:22644:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788463732.093732:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788463732.093736:0:22644:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.153@tcp to nid 0x20000c0a8cc99 (192.168.204.153@tcp) 00000020:01000000:3.0:1788463732.093758:0:22644:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788463732.093760:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788463732.093772:0:22644:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff96178878cd40) 00000020:00000080:3.0:1788463732.093791:0:22644:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788463732.093796:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788463732.093878:0:22644:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788463732.093884:0:22644:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788463732.093890:0:22644:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x841acb7f42a3b1e4 00010000:00080000:3.0:1788463732.093925:0:22644:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96188ced8000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.153@tcp at head 00010000:00010000:3.0:1788463732.094127:0:22644:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1788463732.094402:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485897984:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788463732.094474:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463732.095505:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485897984 00000100:00100000:3.0:1788463732.095516:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485897984 00000100:00100000:3.0:1788463732.095552:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788463732.095560:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875339485897984:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788463732.095598:0:22631:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788463732.123974:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875339485897984:12345-0@lo:38:llog_process_th.0 Request processed in 28392us (29478us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788463732.123990:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:1.0:1788463732.124701:0:22644:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00080000:2.0:1788463732.125181:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9618850d2000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788463732.125188:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788463732.125193:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485897984:0@lo:38:llog_process_th.0 00000040:01000000:1.0:1788463732.125363:0:22644:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788463732.128507:0:22644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788463732.129249:0:22644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1788463732.136075:0:22644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1788463732.136874:0:22650:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788463732.136879:0:22650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788463732.144801:0:22644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788463732.144820:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788463732.144862:0:22644:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788463732.144886:0:22644:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x841acb7f42a3b1eb 00000100:00080000:1.0:1788463732.144896:0:22644:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788463732.144913:0:22644:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96188ced8000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:1.0:1788463732.144952:0:22644:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188d1d3800 x1875339485898112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788463732.145140:0:22644:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788463732.145268:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463732.145273:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463732.145275:0:22644:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788463732.145277:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788463732.145281:0:22644:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1788463732.145282:0:22644:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788463732.145284:0:22644:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788463732.145285:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788463732.145288:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463732.145289:0:22644:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788463732.145291:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788463732.145296:0:22644:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788463732.145299:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463732.145301:0:22644:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788463732.145303:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788463732.145307:0:22644:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.153@tcp to nid 0x20000c0a8cc99 (192.168.204.153@tcp) 00000020:01000000:1.0:1788463732.145332:0:22644:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788463732.145335:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788463732.145348:0:22644:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff96189165cd40) 00000020:00000080:1.0:1788463732.145360:0:22644:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1788463732.145365:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788463732.145454:0:22644:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788463732.145461:0:22644:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788463732.145470:0:22644:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x841acb7f42a3b1f9 00010000:00080000:1.0:1788463732.145511:0:22644:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9617873e8000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.153@tcp at head 00010000:00010000:1.0:1788463732.145722:0:22644:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788463732.145804:0:22644:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788463732.145826:0:22644:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1788463732.146639:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485898112:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788463732.146701:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875339485898112 offset 0 length 520: 4 00000040:00080000:3.0:1788463732.151243:0:22644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788463732.151432:0:22644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1788463732.151563:0:22644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:1.0:1788463732.152341:0:22652:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788463732.152347:0:22652:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788463732.157400:0:22644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788463732.157416:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788463732.157456:0:22644:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788463732.157475:0:22644:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x841acb7f42a3b200 00000100:00080000:3.0:1788463732.157496:0:22644:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788463732.157502:0:22644:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9617873e8000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463732.157538:0:22644:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9618884f5f80 x1875339485898240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788463732.157640:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485898240:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788463732.157693:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875339485898240 offset 0 length 520: 4 00000100:00080000:3.0:1788463732.157771:0:22644:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788463732.157832:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463732.157836:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463732.157838:0:22644:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788463732.157841:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463732.157845:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463732.157846:0:22644:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788463732.157849:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788463732.157851:0:22644:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788463732.157854:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463732.157856:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463732.157857:0:22644:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788463732.157859:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463732.157861:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463732.157862:0:22644:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788463732.157865:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788463732.157890:0:22644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:abd83a7b-f7e3-4d68-aade-6298a66ab956:22644:1875339485898368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788463732.157935:0:22644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463732.157984:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485898368 00000100:00100000:3.0:1788463732.157990:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485898368 00000100:00100000:3.0:1788463732.158029:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788463732.158039:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+9:22644:x1875339485898368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788463732.158163:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+9:22644:x1875339485898368:12345-0@lo:502:llog_process_th.0 Request processed in 111us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463732.158170:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788463732.158210:0:22644:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463732.158230:0:22644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:abd83a7b-f7e3-4d68-aade-6298a66ab956:22644:1875339485898368:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788463732.158253:0:22644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463732.158262:0:22644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463732.158263:0:22644:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788463732.158267:0:22644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788463732.158317:0:22604:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788463732.158337:0:22604:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788463732.158352:0:22604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618be00e800/0x841acb7f42a3b174 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b17b expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463732.158362:0:22604:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff9618be00e800/0x841acb7f42a3b174 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b17b expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463732.158370:0:22604:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9618bf5d9000 from 1 10000000:01000000:3.0:1788463732.158373:0:22604:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788463732.158401:0:22604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618be00f600/0x841acb7f42a3b207 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463732.158408:0:22604:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff9618be00f600/0x841acb7f42a3b207 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463732.158417:0:22604:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff9618be00f600/0x841acb7f42a3b207 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463732.158430:0:22604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485898496:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788463732.158453:0:22604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463732.158463:0:22604:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463732.158760:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485898496 00000100:00100000:0.0:1788463732.158765:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485898496 00000100:00100000:0.0:1788463732.158793:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788463732.158800:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+9:22604:x1875339485898496:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788463732.158810:0:22620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463732.158825:0:22620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96188f6f5200/0x841acb7f42a3b20e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b207 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463732.158849:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96188f6f5200/0x841acb7f42a3b20e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b207 expref: 10 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463732.158860:0:22620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96188f6f5200/0x841acb7f42a3b20e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b207 expref: 10 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463732.158868:0:22620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f5200, rc 0) 00000100:00100000:0.0:1788463732.158910:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+10:22604:x1875339485898496:12345-0@lo:101:mount.lustre.0 Request processed in 110us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463732.158916:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788463732.159502:0:22604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485898496:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463732.159518:0:22604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff9618be00f600/0x841acb7f42a3b207 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b20e expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463732.159528:0:22604:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff9618be00f600/0x841acb7f42a3b207 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b20e expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463732.160448:0:22604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485898624:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788463732.160512:0:22604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463732.160551:0:22604:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463732.160597:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485898624 00000100:00100000:3.0:1788463732.160602:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485898624 00000100:00100000:3.0:1788463732.160904:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788463732.160914:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+10:22604:x1875339485898624:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788463732.160933:0:22618:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788463732.160940:0:22618:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788463732.161027:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+10:22604:x1875339485898624:12345-0@lo:256:mount.lustre.0 Request processed in 115us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463732.161035:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788463732.161302:0:22604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485898624:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788463732.161884:0:22604:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788463732.161910:0:22604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618be00f600/0x841acb7f42a3b207 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b20e expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463732.161920:0:22604:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff9618be00f600/0x841acb7f42a3b207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b20e expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463732.161930:0:22604:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9618bf5d9000 from 1 10000000:01000000:1.0:1788463732.161932:0:22604:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788463732.161977:0:22604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b215 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463732.161986:0:22604:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b215 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463732.161995:0:22604:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b215 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463732.162012:0:22604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485898752:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788463732.162057:0:22604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463732.165381:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485898752 00000100:00100000:0.0:1788463732.165393:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485898752 00000100:00100000:3.0:1788463732.165463:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788463732.165475:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+10:22604:x1875339485898752:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463732.165501:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463732.165524:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618be00ea00/0x841acb7f42a3b21c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b215 expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463732.165550:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618be00ea00/0x841acb7f42a3b21c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b215 expref: 11 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463732.165562:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618be00ea00/0x841acb7f42a3b21c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b215 expref: 11 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463732.165571:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618be00ea00, rc 0) 00000100:00100000:3.0:1788463732.165652:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+11:22604:x1875339485898752:12345-0@lo:101:mount.lustre.0 Request processed in 180us (3595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463732.165720:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788463732.165809:0:22604:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b224ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463732.165831:0:22604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485898752:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788463732.165848:0:22604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b215 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b21c expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463732.165858:0:22604:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b215 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b21c expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463732.165931:0:22604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad769f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485898880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463732.165970:0:22604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463732.165990:0:22604:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618902dbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788463732.166307:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485898880 00000100:00100000:1.0:1788463732.166314:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485898880 00000100:00100000:1.0:1788463732.166339:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788463732.166346:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+11:22604:x1875339485898880:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463732.166504:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+11:22604:x1875339485898880:12345-0@lo:501:mount.lustre.0 Request processed in 158us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463732.166521:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788463732.166766:0:22604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad769f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485898880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463732.166823:0:22604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad769f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485899008:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788463732.166861:0:22604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463732.166888:0:22604:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618902dbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788463732.167056:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485899008 00000100:00100000:0.0:1788463732.167061:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485899008 00000100:00100000:0.0:1788463732.167093:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788463732.167100:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+11:22604:x1875339485899008:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788463732.167198:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+11:22604:x1875339485899008:12345-0@lo:503:mount.lustre.0 Request processed in 98us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463732.167205:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788463732.167376:0:22604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad769f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485899008:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788463732.168336:0:22654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:abd83a7b-f7e3-4d68-aade-6298a66ab956:22654:1875339485899136:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463732.168392:0:22654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463732.168467:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b224e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788463732.168501:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485899136 00000100:00100000:0.0:1788463732.168507:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485899136 00000100:00100000:0.0:1788463732.168599:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788463732.168608:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+11:22654:x1875339485899136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463732.169429:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+11:22654:x1875339485899136:12345-0@lo:502:llog_process_th.0 Request processed in 818us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463732.169438:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788463732.169542:0:22654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:abd83a7b-f7e3-4d68-aade-6298a66ab956:22654:1875339485899136:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788463732.169571:0:22654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463732.169626:0:22654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463732.169629:0:22654:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788463732.169637:0:22654:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9618bf5d9000 00000020:00000080:2.0:1788463732.169640:0:22654:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788463732.169648:0:22654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463732.169650:0:22654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463732.169652:0:22654:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788463732.169654:0:22654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463732.169656:0:22654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463732.169658:0:22654:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788463732.169661:0:22654:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9618bf5d9000 00000020:00000080:2.0:1788463732.169663:0:22654:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788463732.169722:0:22654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463732.169726:0:22654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463732.169727:0:22654:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788463732.169730:0:22654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463732.169732:0:22654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463732.169734:0:22654:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788463732.169737:0:22654:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9618bf5d9000 00000020:00000080:2.0:1788463732.169739:0:22654:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788463732.169755:0:22654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463732.169758:0:22654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463732.169759:0:22654:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788463732.169761:0:22654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463732.169764:0:22654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463732.169766:0:22654:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788463732.169769:0:22654:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9618bf5d9000 00000020:00000080:2.0:1788463732.169771:0:22654:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788463732.169820:0:22654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad769f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:abd83a7b-f7e3-4d68-aade-6298a66ab956:22654:1875339485899264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463732.169865:0:22654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463732.181478:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618902dbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788463732.181765:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485899264 00000100:00100000:1.0:1788463732.186982:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485899264 00000100:00100000:1.0:1788463732.187066:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788463732.187076:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+11:22654:x1875339485899264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463732.187290:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+11:22654:x1875339485899264:12345-0@lo:502:llog_process_th.0 Request processed in 215us (17423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463732.187298:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788463732.188125:0:22654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad769f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:abd83a7b-f7e3-4d68-aade-6298a66ab956:22654:1875339485899264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788463732.188739:0:22654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463732.188748:0:22654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463732.188751:0:22654:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788463732.188756:0:22654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788463732.188903:0:22604:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788463732.188928:0:22604:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788463732.188950:0:22604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b215 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b21c expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463732.189364:0:22604:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b215 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b21c expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463732.189421:0:22604:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788463732.189424:0:22604:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9618bf5d9000 10000000:01000000:2.0:1788463732.189427:0:22604:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9618bf5d9000 10000000:01000000:2.0:1788463732.189431:0:22604:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788463732.189438:0:22604:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9618bf5d9000 from 1 10000000:01000000:2.0:1788463732.189440:0:22604:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788463732.189478:0:22604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e20c00/0x841acb7f42a3b223 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463732.189497:0:22604:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961785e20c00/0x841acb7f42a3b223 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463732.189507:0:22604:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961785e20c00/0x841acb7f42a3b223 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463732.189543:0:22604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad769f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485899392:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788463732.191712:0:22604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463732.191775:0:22604:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618902dbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788463732.191929:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485899392 00000100:00100000:1.0:1788463732.191937:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485899392 00000100:00100000:1.0:1788463732.192007:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788463732.192017:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+11:22604:x1875339485899392:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788463732.192033:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463732.192055:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961786bde400/0x841acb7f42a3b22a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b223 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463732.192083:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961786bde400/0x841acb7f42a3b22a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b223 expref: 12 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463732.192094:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961786bde400/0x841acb7f42a3b22a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b223 expref: 12 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463732.192104:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bde400, rc 0) 00000100:00100000:1.0:1788463732.192147:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+12:22604:x1875339485899392:12345-0@lo:101:mount.lustre.0 Request processed in 132us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463732.192174:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788463732.192397:0:22604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad769f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485899392:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788463732.192414:0:22604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961785e20c00/0x841acb7f42a3b223 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b22a expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463732.192423:0:22604:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961785e20c00/0x841acb7f42a3b223 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b22a expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463732.192512:0:22604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad769f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485899520:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463732.192543:0:22604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463732.192560:0:22604:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618902dbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788463732.192696:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485899520 00000100:00100000:2.0:1788463732.192701:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485899520 00000100:00100000:2.0:1788463732.192731:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788463732.192739:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+12:22604:x1875339485899520:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463732.195069:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+12:22604:x1875339485899520:12345-0@lo:501:mount.lustre.0 Request processed in 2322us (2517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463732.195082:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788463732.195133:0:22604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad769f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485899520:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463732.195915:0:22604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad769f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485899648:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788463732.196077:0:22604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463732.196121:0:22604:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618902dbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788463732.196273:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485899648 00000100:00100000:1.0:1788463732.196279:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485899648 00000100:00100000:1.0:1788463732.196317:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788463732.196324:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+12:22604:x1875339485899648:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788463732.196436:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+12:22604:x1875339485899648:12345-0@lo:503:mount.lustre.0 Request processed in 111us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463732.196444:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788463732.196886:0:22604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad769f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485899648:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788463732.201401:0:22658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:abd83a7b-f7e3-4d68-aade-6298a66ab956:22658:1875339485899776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463732.201521:0:22658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463732.201569:0:22658:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b224e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463732.203454:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485899776 00000100:00100000:2.0:1788463732.203468:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485899776 00000100:00100000:2.0:1788463732.203536:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788463732.203546:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961885030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+12:22658:x1875339485899776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463732.203749:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961885030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+12:22658:x1875339485899776:12345-0@lo:502:llog_process_th.0 Request processed in 204us (2262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463732.203757:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788463732.204303:0:22658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:abd83a7b-f7e3-4d68-aade-6298a66ab956:22658:1875339485899776:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788463732.204373:0:22658:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788463732.204389:0:22658:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff961891658000) 00000020:00000080:1.0:1788463732.204407:0:22658:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1788463732.204529:0:22658:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9618bf5d9000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788463732.204533:0:22658:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9618bf5d9000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788463732.204536:0:22658:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9618bf5d9000 4 00010000:00080000:1.0:1788463732.204564:0:22658:0:(ldlm_lib.c:102:import_set_conn()) imp ffff961883734800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.153@tcp at head 00010000:00010000:1.0:1788463732.208614:0:22658:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1788463732.212448:0:22658:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788463732.212515:0:22658:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788463732.212530:0:22658:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x841acb7f42a3b238 00000100:00080000:1.0:1788463732.212542:0:22658:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788463732.212559:0:22658:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff961883734800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:1.0:1788463732.212611:0:22658:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188d1d1880 x1875339485899904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788463732.212645:0:22658:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788463732.214566:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875339485899904:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788463732.214666:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463732.216141:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485899904 00000100:00100000:1.0:1788463732.216226:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485899904 00000100:00100000:1.0:1788463732.216279:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788463732.216289:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875339485899904:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788463732.216375:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875339485899904:12345-0@lo:38:llog_process_th.0 Request processed in 86us (1709us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788463732.216382:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788463732.216431:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788463732.216443:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961883734800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788463732.216447:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788463732.216451:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875339485899904:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788463732.217676:0:22658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:abd83a7b-f7e3-4d68-aade-6298a66ab956:22658:1875339485900032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463732.218521:0:22658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463732.221100:0:22658:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b224e840 going to sleep for 11 seconds 00000100:00100000:2.0:1788463732.227975:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485900032 00000100:00100000:2.0:1788463732.227995:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485900032 00000100:00100000:2.0:1788463732.228059:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788463732.228070:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+12:22658:x1875339485900032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463732.231430:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+12:22658:x1875339485900032:12345-0@lo:502:llog_process_th.0 Request processed in 3350us (12898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463732.231446:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788463732.231885:0:22658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:abd83a7b-f7e3-4d68-aade-6298a66ab956:22658:1875339485900032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463732.231968:0:22658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfeaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:abd83a7b-f7e3-4d68-aade-6298a66ab956:22658:1875339485900160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463732.232020:0:22658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463732.232064:0:22658:0:(client.c:2716:ptlrpc_set_wait()) set ffff961898b4c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463732.232659:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485900160 00000100:00100000:1.0:1788463732.232670:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485900160 00000100:00100000:1.0:1788463732.232729:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788463732.232739:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+12:22658:x1875339485900160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463732.233005:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+12:22658:x1875339485900160:12345-0@lo:502:llog_process_th.0 Request processed in 266us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463732.233012:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788463732.234752:0:22658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfeaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:abd83a7b-f7e3-4d68-aade-6298a66ab956:22658:1875339485900160:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788463732.234927:0:22658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788463732.235110:0:22604:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788463732.235140:0:22604:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788463732.235171:0:22604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e20c00/0x841acb7f42a3b223 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b22a expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463732.235182:0:22604:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961785e20c00/0x841acb7f42a3b223 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b22a expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788463732.235235:0:22604:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788463732.235237:0:22604:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788463732.235242:0:22604:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463732.235243:0:22604:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463732.235244:0:22604:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463732.235247:0:22604:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463732.235248:0:22604:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788463732.235249:0:22604:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788463732.235250:0:22604:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463732.235251:0:22604:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788463732.235256:0:22604:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788463732.235257:0:22604:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788463732.235259:0:22604:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788463732.235260:0:22604:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463732.235261:0:22604:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463732.235261:0:22604:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463732.235263:0:22604:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463732.235264:0:22604:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788463732.235264:0:22604:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788463732.235265:0:22604:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463732.235266:0:22604:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788463732.235286:0:22604:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788463732.235304:0:22604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485900288:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788463732.235363:0:22604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463732.235399:0:22604:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618902dbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788463732.235424:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485900288 00000100:00100000:2.0:1788463732.235430:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485900288 00000100:00100000:2.0:1788463732.235474:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788463732.235493:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+12:22604:x1875339485900288:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788463732.235519:0:22620:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788463732.235532:0:22620:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788463732.238537:0:22620:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788463732.238710:0:22620:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788463732.243358:0:22642:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788463732.243369:0:22642:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788463732.243396:0:22642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9618be00fe00/0x841acb7f42a3b23f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463732.243415:0:22642:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96188f6f5200/0x841acb7f42a3b20e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b207 expref: 12 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463732.243424:0:22642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9618be00fe00/0x841acb7f42a3b23f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463732.243476:0:22642:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96188f6f5200/0x841acb7f42a3b20e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3b207 expref: 12 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463732.243501:0:22642:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96188f6f5200/0x841acb7f42a3b20e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3b207 expref: 12 pid: 22620 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463732.243516:0:22642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22642:1875339485900416:0@lo:104: 00000100:00100000:3.0:1788463732.245367:0:22642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463732.245498:0:22642:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891652f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788463732.246388:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+12:22604:x1875339485900288:12345-0@lo:253:mount.lustre.0 Request processed in 10900us (11018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463732.246402:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788463732.246538:0:22604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:22604:1875339485900288:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788463732.246555:0:22604:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788463732.246558:0:22604:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788463732.246568:0:22604:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788463732.246569:0:22604:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463732.246570:0:22604:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463732.246571:0:22604:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463732.246598:0:22604:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463732.246600:0:22604:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788463732.246601:0:22604:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788463732.246603:0:22604:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463732.246604:0:22604:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788463732.246619:0:22604:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788463732.253318:0:22609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485900416 00000100:00100000:3.0:1788463732.253335:0:22609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485900416 00000100:00100000:3.0:1788463732.254278:0:22609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788463732.254293:0:22609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:abd83a7b-f7e3-4d68-aade-6298a66ab956+3:22642:x1875339485900416:12345-0@lo:104: 00010000:00010000:3.0:1788463732.254316:0:22609:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff9618be00f600/0x841acb7f42a3b207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3b20e expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463732.254417:0:22609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788463732.254437:0:22609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:abd83a7b-f7e3-4d68-aade-6298a66ab956+3:22642:x1875339485900416:12345-0@lo:104: Request processed in 148us (9076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463732.254444:0:22609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788463732.254548:0:22642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22642:1875339485900416:0@lo:104: 00010000:00010000:0.0:1788463732.254597:0:22642:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9618be00fe00/0x841acb7f42a3b23f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463732.257054:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463732.257071:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff9618be00f600/0x841acb7f42a3b207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3b20e expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463732.257082:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618be00f600 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463732.257087:0:22615:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff9618be00f600/0x841acb7f42a3b207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3b20e expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463732.257097:0:22615:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff9618be00f600/0x841acb7f42a3b207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3b20e expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463732.257104:0:22615:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff9618be00f600/0x841acb7f42a3b207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3b20e expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463732.257109:0:22615:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788463732.257183:0:22615:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff9618be00f600/0x841acb7f42a3b207 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b20e expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463732.257189:0:22615:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463732.257211:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff9618be00f600/0x841acb7f42a3b207 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b20e expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463732.257216:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff9618be00f600/0x841acb7f42a3b207 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b20e expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463732.257239:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463732.257240:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463732.257242:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463732.257306:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:abd83a7b-f7e3-4d68-aade-6298a66ab956:3648:1875339485900544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463732.257377:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463732.257472:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485900544 00000100:00100000:0.0:1788463732.257480:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485900544 00010000:00010000:0.0:1788463732.257516:0:22611:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96188f6f5200/0x841acb7f42a3b20e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3b207 expref: 12 pid: 22620 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463732.257551:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788463732.257560:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cfeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:abd83a7b-f7e3-4d68-aade-6298a66ab956+12:3648:x1875339485900544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788463732.257592:0:22611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463732.257599:0:22611:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96188f6f5200/0x841acb7f42a3b20e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3b207 expref: 12 pid: 22620 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463732.257610:0:22611:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96188f6f5200/0x841acb7f42a3b20e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3b207 expref: 12 pid: 22620 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463732.257625:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96188f6f5200/0x841acb7f42a3b20e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3b207 expref: 12 pid: 22620 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463732.257638:0:22611:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9618be00fe00/0x841acb7f42a3b23f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463732.257647:0:22611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618be00fe00/0x841acb7f42a3b23f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788463732.257663:0:22611:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014293953s 00010000:00010000:0.0:1788463732.257668:0:22611:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9618be00fe00/0x841acb7f42a3b23f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463732.257694:0:22611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9618be00fe00/0x841acb7f42a3b23f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463732.257708:0:22611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9618be00fe00/0x841acb7f42a3b23f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463732.257715:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9618be00fe00/0x841acb7f42a3b23f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463732.257720:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618be00fe00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463732.257724:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9618be00fe00/0x841acb7f42a3b23f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463732.257733:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9618be00fe00/0x841acb7f42a3b23f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463732.257747:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9618be00fe00/0x841acb7f42a3b23f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463732.257757:0:22611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463732.259118:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cfeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:abd83a7b-f7e3-4d68-aade-6298a66ab956+11:3648:x1875339485900544:12345-0@lo:103:ldlm_bl.0 Request processed in 1554us (1736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463732.259130:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788463732.259185:0:22642:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9618be00fe00/0x841acb7f42a3b23f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463732.259195:0:22642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9618be00fe00/0x841acb7f42a3b23f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463732.259202:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618be00fe00/0x841acb7f42a3b23f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463732.259248:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:abd83a7b-f7e3-4d68-aade-6298a66ab956:3648:1875339485900544:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788463732.301290:0:22604:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:0.0:1788463732.306788:0:22604:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788463732.309395:0:22667:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1788463732.309933:0:22667:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788463732.310814:0:22604:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:01000000:1.0:1788463732.312333:0:22604:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788463732.312378:0:22604:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788463732.313455:0:22604:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788463732.313471:0:22604:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788463732.313549:0:22604:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788463732.316626:0:22667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788463732.316708:0:22667:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1788463732.317892:0:22604:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000020:00080000:2.0:1788463732.318507:0:22666:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:2.0:1788463732.318512:0:22666:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000100:00080000:0.0:1788463732.318935:0:22668:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff96188cfeaa00 x1875339485900672/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463732.318948:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889fc9180 going to sleep for 0 seconds 00000040:00080000:1.0:1788463732.319347:0:22604:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788463732.319403:0:22604:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788463732.321660:0:22604:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:1.0:1788463732.322432:0:22604:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:1.0:1788463732.325666:0:22604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1788463732.330857:0:22604:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788463732.330900:0:22604:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba474147b988 00100000:10000000:1.0:1788463732.330910:0:22604:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788463732.336650:0:22604:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788463732.336670:0:22604:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.153@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788463732.336701:0:22604:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788463732.336727:0:22604:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788463732.339034:0:22604:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788463732.343434:0:22604:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788463732.740763:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788463733.124658:0:22623:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788463733.124667:0:22623:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9618bf5d9000 from 11 10000000:01000000:2.0:1788463733.124673:0:22623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788463733.124737:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b246 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463733.124749:0:22623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b246 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463733.124760:0:22623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b246 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463733.124789:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485900800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788463733.124862:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463733.124911:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618bf56c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788463733.125237:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485900800 00000100:00100000:3.0:1788463733.125245:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485900800 00000100:00100000:3.0:1788463733.125295:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788463733.125305:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+11:22623:x1875339485900800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463733.125318:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463733.125333:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618be00fe00/0x841acb7f42a3b24d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b246 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463733.125356:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618be00fe00/0x841acb7f42a3b24d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b246 expref: 12 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463733.125367:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618be00fe00/0x841acb7f42a3b24d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b246 expref: 12 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463733.125376:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618be00fe00, rc 0) 00000100:00100000:3.0:1788463733.125424:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+12:22623:x1875339485900800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463733.125431:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788463733.125488:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485900800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463733.125505:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b246 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b24d expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463733.125515:0:22623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b246 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b24d expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463733.125607:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485900928:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788463733.125652:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463733.125670:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618916523c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463733.125906:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485900928 00000100:00100000:2.0:1788463733.125916:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485900928 00000100:00100000:2.0:1788463733.125950:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788463733.125956:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+12:22623:x1875339485900928:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788463733.125970:0:22618:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788463733.125986:0:22618:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788463733.125989:0:22618:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788463733.126065:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+12:22623:x1875339485900928:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463733.126072:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788463733.126342:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485900928:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788463733.126385:0:22623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788463733.126393:0:22623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b246 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b24d expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463733.126402:0:22623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b246 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b24d expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788463733.320262:0:22662:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788463733.320271:0:22662:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788463733.321527:0:22662:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788463733.321539:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788463733.379878:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889fc9180 going to sleep for 0 seconds 00010000:00010000:0.0:1788463733.763784:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788463734.352302:0:22662:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788463734.352313:0:22662:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788463734.352441:0:22662:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1788463734.352495:0:22662:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788463734.352680:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:0.0:1788463734.403785:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889fc9180 going to sleep for 0 seconds 00010000:00010000:0.0:1788463734.790493:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463735.427654:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889fc9180 going to sleep for 0 seconds 00010000:00010000:0.0:1788463735.818862:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463736.452832:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889fc9180 going to sleep for 0 seconds 00010000:00010000:0.0:1788463736.836239:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788463737.222253:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788463737.222261:0:1365:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788463737.222264:0:1365:0:(import.c:65:import_set_state_nolock()) ffff9618850d2000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788463737.222272:0:1365:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 771 00000100:00080000:0.0:1788463737.222278:0:1365:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788463737.222286:0:1365:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9618850d2000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:0.0:1788463737.222310:0:1365:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188cfe8380 x1875339485901184/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788463737.222334:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463737.222338:0:1365:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788463737.222340:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463737.222343:0:1365:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788463737.222345:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788463737.222348:0:1365:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788463737.222350:0:1365:0:(import.c:65:import_set_state_nolock()) ffff961883734800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788463737.222355:0:1365:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff961883734800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:0.0:1788463737.222369:0:1365:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188cfeb100 x1875339485901312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788463737.222419:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:abd83a7b-f7e3-4d68-aade-6298a66ab956:3649:1875339485901056:0@lo:400:kworker.0 00000100:00100000:0.0:1788463737.222492:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463737.222717:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfe8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485901184:0@lo:38:kworker.0 00000100:00100000:2.0:1788463737.222753:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463737.222786:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875339485901312:0@lo:38:kworker.0 00000100:00100000:2.0:1788463737.222810:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463737.222851:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485901056 00000100:00100000:2.0:1788463737.222858:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485901056 00000100:00100000:2.0:1788463737.222915:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788463737.222924:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+12:3649:x1875339485901056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463737.222976:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+12:3649:x1875339485901056:12345-0@lo:400:kworker.0 Request processed in 53us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463737.222983:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788463737.223030:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:abd83a7b-f7e3-4d68-aade-6298a66ab956:3649:1875339485901056:0@lo:400:kworker.0 00000100:00100000:0.0:1788463737.224211:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485901184 00000100:00100000:0.0:1788463737.224221:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485901184 00000100:00100000:0.0:1788463737.224262:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788463737.224269:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875339485901184:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788463737.224288:0:22632:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788463737.224348:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875339485901184:12345-0@lo:38:kworker.0 Request processed in 78us (1594us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788463737.224355:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788463737.224689:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485901312 00000100:00100000:1.0:1788463737.224695:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485901312 00000100:00100000:1.0:1788463737.224723:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788463737.224741:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875339485901312:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788463737.224759:0:22628:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 776 last 0 00000100:00080000:2.0:1788463737.224785:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9618850d2000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788463737.224790:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000020:00000080:1.0:1788463737.224792:0:22628:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x841acb7f42a3b254 00000100:00100000:2.0:1788463737.224794:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfe8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485901184:0@lo:38:kworker.0 00000004:00100000:1.0:1788463737.224806:0:22628:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788463737.224939:0:22628:0:(import.c:65:import_set_state_nolock()) ffff96178732a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788463737.225001:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875339485901312:12345-0@lo:38:kworker.0 Request processed in 259us (2188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463737.225008:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788463737.225354:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96188cfeb100 x1875339485901312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788463747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788463737.225395:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788463737.225404:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788463737.225410:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788463737.225412:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961883734800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788463737.225418:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875339485901312:0@lo:38:kworker.0 00000100:00100000:2.0:1788463737.476353:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889fc9180 going to sleep for 0 seconds 00010000:00010000:0.0:1788463737.860980:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463738.499864:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889fc9180 going to sleep for 0 seconds 00000001:02000400:0.0:1788463738.559417:0:22910:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg453-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788463738.884691:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463739.523660:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889fc9180 going to sleep for 0 seconds 00000020:00000004:0.0:1788463739.754284:0:22963:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788463739.754479:0:22963:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788463739.915131:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463740.547708:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889fc9180 going to sleep for 0 seconds 00000020:00000004:2.0:1788463740.782523:0:23014:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788463740.782764:0:23014:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788463740.932695:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463741.573798:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889fc9180 going to sleep for 0 seconds 00010000:00010000:1.0:1788463741.956060:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463742.340550:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463732/real 1788463732] req@ffff9618884f5f80 x1875339485898240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463742 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463742.340873:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9618884f5f80 x1875339485898240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463742 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463742.340886:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463732/real 1788463732] req@ffff96188d1d3800 x1875339485898112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463742 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463742.340899:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96188d1d3800 x1875339485898112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463742 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788463742.340919:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9617873e8000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788463742.340927:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788463742.340931:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485898240:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788463742.340937:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188ced8000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788463742.340941:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788463742.340944:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485898112:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788463742.341725:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788463742.341730:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788463742.341734:0:36:0:(import.c:65:import_set_state_nolock()) ffff9618850d2000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788463742.341740:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 776 00000100:00080000:2.0:1788463742.341746:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788463742.341763:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9618850d2000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:2.0:1788463742.341787:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9618ad768700 x1875339485901568/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788463742.341804:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788463742.341807:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788463742.341809:0:36:0:(import.c:65:import_set_state_nolock()) ffff96188ced8000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788463742.341813:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 771 00000100:00080000:2.0:1788463742.341823:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788463742.341827:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96188ced8000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:2.0:1788463742.341842:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9618ad769180 x1875339485901696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788463742.341851:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788463742.341853:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788463742.341855:0:36:0:(import.c:65:import_set_state_nolock()) ffff9617873e8000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788463742.341858:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 771 00000100:00080000:2.0:1788463742.341861:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788463742.341864:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9617873e8000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:2.0:1788463742.341876:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9618ad76b100 x1875339485901824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788463742.342145:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:abd83a7b-f7e3-4d68-aade-6298a66ab956:3650:1875339485901440:0@lo:400:kworker.0 00000100:00100000:0.0:1788463742.342218:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463742.342282:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463742.342300:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485901952:0@lo:400:kworker.0 00000100:00100000:0.0:1788463742.342335:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463742.342366:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485901568:0@lo:38:kworker.0 00000100:00100000:0.0:1788463742.342398:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463742.342418:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485901696:0@lo:8:kworker.0 00000400:00000100:0.0:1788463742.342451:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875339485901696 offset 0 length 520: 4 00000100:00100000:0.0:1788463742.342465:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485901824:0@lo:8:kworker.0 00000400:00000100:0.0:1788463742.342502:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875339485901824 offset 0 length 520: 4 00000100:00100000:0.0:1788463742.342530:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485901568 00000100:00100000:0.0:1788463742.342539:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485901568 00000100:00100000:0.0:1788463742.342569:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788463742.342611:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cfe8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875339485901568:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788463742.342631:0:22632:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788463742.342852:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cfe8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875339485901568:12345-0@lo:38:kworker.0 Request processed in 240us (452us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788463742.342861:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788463742.342899:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9618850d2000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788463742.342903:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788463742.342906:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485901568:0@lo:38:kworker.0 00000100:00100000:2.0:1788463742.344198:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485901440 00000100:00100000:2.0:1788463742.344209:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485901440 00000100:00100000:2.0:1788463742.344255:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788463742.344265:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+12:3650:x1875339485901440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463742.344349:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+12:3650:x1875339485901440:12345-0@lo:400:kworker.0 Request processed in 85us (2130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463742.344356:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788463742.344401:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485901952 00000100:00100000:2.0:1788463742.344406:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485901952 00000100:00100000:2.0:1788463742.344432:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788463742.344439:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cfe9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485901952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463742.344473:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cfe9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485901952:12345-0@lo:400:kworker.0 Request processed in 35us (2137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463742.344480:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788463742.344540:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9618ad769500 x1875339485901952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463742.344553:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485901952:0@lo:400:kworker.0 00000100:00100000:2.0:1788463742.344566:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:abd83a7b-f7e3-4d68-aade-6298a66ab956:3650:1875339485901440:0@lo:400:kworker.0 00000100:00100000:2.0:1788463742.597382:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889fc9180 going to sleep for 0 seconds 00010000:00010000:1.0:1788463742.979709:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463743.619953:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889fc9180 going to sleep for 0 seconds 00010000:00010000:1.0:1788463744.003695:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788463744.580188:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788463744.648667:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889fc9180 going to sleep for 0 seconds 00010000:00010000:0.0:1788463745.029129:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463745.668648:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889fc9180 going to sleep for 0 seconds 00010000:00010000:1.0:1788463746.051710:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463746.695765:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889fc9180 going to sleep for 0 seconds 00010000:00010000:3.0:1788463747.077227:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788463747.476458:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788463747.476464:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788463747.476468:0:36:0:(import.c:65:import_set_state_nolock()) ffff9618850d2000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788463747.476487:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 781 00000100:00080000:1.0:1788463747.476494:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788463747.476501:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9618850d2000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:1.0:1788463747.476526:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188d1d0000 x1875339485902208/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788463747.476542:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788463747.476545:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788463747.476548:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788463747.476551:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788463747.476609:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485902336:0@lo:400:kworker.0 00000100:00100000:1.0:1788463747.476689:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463747.476746:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463747.476753:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:abd83a7b-f7e3-4d68-aade-6298a66ab956:3649:1875339485902080:0@lo:400:kworker.0 00000100:00100000:1.0:1788463747.476783:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463747.476836:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485902080 00000100:00100000:1.0:1788463747.476844:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485902080 00000100:00100000:1.0:1788463747.476890:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788463747.476899:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+12:3649:x1875339485902080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463747.476966:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+12:3649:x1875339485902080:12345-0@lo:400:kworker.0 Request processed in 67us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463747.476974:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788463747.477019:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485902208:0@lo:38:kworker.0 00000100:00100000:1.0:1788463747.477050:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463747.477097:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:abd83a7b-f7e3-4d68-aade-6298a66ab956:3649:1875339485902080:0@lo:400:kworker.0 00000100:00100000:0.0:1788463747.478100:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485902336 00000100:00100000:0.0:1788463747.478126:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485902336 00000100:00100000:0.0:1788463747.478186:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788463747.478210:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485902336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463747.478287:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485902336:12345-0@lo:400:kworker.0 Request processed in 83us (1598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463747.478294:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788463747.478317:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485902208 00000100:00100000:0.0:1788463747.478331:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485902208 00000100:00100000:0.0:1788463747.478354:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788463747.478358:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875339485902208:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788463747.478376:0:22632:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788463747.478416:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875339485902208:12345-0@lo:38:kworker.0 Request processed in 55us (1365us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788463747.478422:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788463747.478458:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9618850d2000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788463747.478463:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788463747.478466:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485902208:0@lo:38:kworker.0 00010000:00080000:1.0:1788463747.478467:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96188d1d2d80 x1875339485902336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463747.478490:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485902336:0@lo:400:kworker.0 00000100:00100000:1.0:1788463747.718049:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889fc9180 going to sleep for 0 seconds 00010000:00010000:1.0:1788463748.099695:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788463748.398065:0:23359:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788463748.398069:0:23359:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788463748.398071:0:23359:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788463748.398207:0:23359:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff961787d22000 00000020:01000004:2.0:1788463748.398225:0:23359:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1788463748.398236:0:23359:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788463748.398251:0:23359:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff96188d3a4d40) 00000020:00000080:2.0:1788463748.398270:0:23359:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788463748.448066:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1788463748.448780:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788463748.449181:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788463748.449471:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1788463748.449711:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788463748.449926:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1788463748.450130:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788463748.450416:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1788463748.450633:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788463748.450847:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788463748.451058:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1788463748.451999:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788463748.452225:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788463748.452510:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1788463748.452820:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788463748.453004:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1788463748.453207:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1788463748.453485:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788463748.453771:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788463748.453986:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788463748.454208:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1788463748.454508:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788463748.454805:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788463748.455001:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788463748.455197:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788463748.455453:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1788463748.455783:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788463748.455980:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1788463748.456159:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788463748.456466:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788463748.456683:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788463748.456901:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1788463748.457082:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788463748.457755:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788463748.459412:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788463748.459810:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788463748.460025:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788463748.460259:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1788463748.460680:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788463748.460919:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788463748.461115:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788463748.461432:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1788463748.461723:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788463748.461961:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788463748.462154:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1788463748.462540:0:23359:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1788463748.464202:0:23359:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788463748.464552:0:23359:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788463748.464565:0:23359:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788463748.464805:0:23359:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x841acb7f42a3b262 00000020:01000004:0.0:1788463748.464814:0:23359:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788463748.464843:0:23359:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.153@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788463748.464847:0:23359:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788463748.464853:0:23359:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788463748.464887:0:23359:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1788463748.464891:0:23359:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.153@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788463748.469271:0:23359:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.153@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788463748.469319:0:23359:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.153@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1788463748.469324:0:23359:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788463748.469326:0:23359:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788463748.469328:0:23359:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788463748.469329:0:23359:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788463748.469434:0:23359:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788463748.469436:0:23359:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788463748.469437:0:23359:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788463748.469440:0:23359:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788463748.469441:0:23359:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788463748.469446:0:23359:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1788463748.469448:0:23359:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788463748.469449:0:23359:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788463748.469450:0:23359:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788463748.469451:0:23359:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788463748.469452:0:23359:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788463748.469453:0:23359:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788463748.469454:0:23359:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788463748.469455:0:23359:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788463748.469456:0:23359:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788463748.469537:0:23359:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788463748.469558:0:23359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfeb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485902464:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788463748.469655:0:23359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463748.469767:0:23359:0:(client.c:2716:ptlrpc_set_wait()) set ffff961885478c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788463748.469814:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485902464 00000100:00100000:2.0:1788463748.469823:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485902464 00000100:00100000:2.0:1788463748.469932:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788463748.469944:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+12:23359:x1875339485902464:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788463748.469982:0:22618:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788463748.469985:0:22618:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1788463748.469993:0:22618:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788463748.470328:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+12:23359:x1875339485902464:12345-0@lo:253:mount.lustre.0 Request processed in 386us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463748.470347:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788463748.470611:0:23359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfeb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485902464:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788463748.470625:0:23359:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788463748.470638:0:23359:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788463748.470639:0:23359:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788463748.470641:0:23359:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788463748.470642:0:23359:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788463748.470643:0:23359:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788463748.470644:0:23359:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788463748.470645:0:23359:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788463748.470647:0:23359:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788463748.470648:0:23359:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788463748.470666:0:23359:0:(tgt_mount.c:101:server_register_mount()) register mount ffff961787d22000 from lustre-MDT0001 10000000:01000000:0.0:1788463748.470694:0:23359:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788463748.470697:0:23359:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788463748.470705:0:23359:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9617887899c0 local copy 00010000:00010000:0.0:1788463748.470715:0:23359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5e00/0x841acb7f42a3b158 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b15f expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463748.470805:0:23359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfeb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485902592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463748.470840:0:23359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463748.470865:0:23359:0:(client.c:2716:ptlrpc_set_wait()) set ffff961885478c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788463748.470925:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485902592 00000100:00100000:1.0:1788463748.470932:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485902592 00000100:00100000:1.0:1788463748.470977:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788463748.470987:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+12:23359:x1875339485902592:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463748.471069:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+12:23359:x1875339485902592:12345-0@lo:501:mount.lustre.0 Request processed in 82us (227us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788463748.471076:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788463748.471367:0:23359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfeb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485902592:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788463748.471381:0:23359:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788463748.471402:0:23359:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788463748.471409:0:23359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5e00/0x841acb7f42a3b158 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b15f expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463748.471417:0:23359:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff96188f6f5e00/0x841acb7f42a3b158 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b15f expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463748.471448:0:23359:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff961787d22000 10000000:01000000:0.0:1788463748.471453:0:23359:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788463748.471458:0:23359:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9617887899c0 10000000:01000000:0.0:1788463748.471615:0:23359:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788463748.471619:0:23359:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9617887899c0 from 1 10000000:01000000:0.0:1788463748.471623:0:23359:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788463748.471650:0:23359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a3b269 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463748.471659:0:23359:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a3b269 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463748.471669:0:23359:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a3b269 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463748.471682:0:23359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfeb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485902720:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788463748.471714:0:23359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463748.471736:0:23359:0:(client.c:2716:ptlrpc_set_wait()) set ffff961885478c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788463748.471809:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485902720 00000100:00100000:3.0:1788463748.471815:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485902720 00000100:00100000:3.0:1788463748.471843:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788463748.471851:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+12:23359:x1875339485902720:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463748.471861:0:22620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463748.471879:0:22620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618be00f600/0x841acb7f42a3b270 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b269 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.471905:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618be00f600/0x841acb7f42a3b270 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b269 expref: 13 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.471929:0:22620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618be00f600/0x841acb7f42a3b270 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b269 expref: 13 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.471939:0:22620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618be00f600, rc 0) 00000100:00100000:3.0:1788463748.471980:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+13:23359:x1875339485902720:12345-0@lo:101:mount.lustre.0 Request processed in 130us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463748.471987:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788463748.472061:0:23359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfeb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485902720:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788463748.472075:0:23359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a3b269 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b270 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463748.472085:0:23359:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a3b269 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b270 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463748.472101:0:23359:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788463748.472117:0:23359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a3b269 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b270 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463748.472125:0:23359:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a3b269 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b270 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463748.472134:0:23359:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff961787d22000 10000000:01000000:0.0:1788463748.472142:0:23359:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788463748.472146:0:23359:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff961787d22000 from 1 10000000:01000000:0.0:1788463748.472148:0:23359:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788463748.472163:0:23359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5000/0x841acb7f42a3b277 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463748.472182:0:23359:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff96188f6f5000/0x841acb7f42a3b277 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463748.472191:0:23359:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff96188f6f5000/0x841acb7f42a3b277 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463748.472204:0:23359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfeb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485902848:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788463748.472228:0:23359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463748.472241:0:23359:0:(client.c:2716:ptlrpc_set_wait()) set ffff961885478c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788463748.472298:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485902848 00000100:00100000:1.0:1788463748.472303:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485902848 00000100:00100000:1.0:1788463748.472324:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788463748.472342:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+13:23359:x1875339485902848:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788463748.472350:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463748.472359:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961786bdea00/0x841acb7f42a3b27e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b277 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463748.472373:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961786bdea00/0x841acb7f42a3b27e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b277 expref: 14 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463748.472381:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961786bdea00/0x841acb7f42a3b27e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b277 expref: 14 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463748.472389:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdea00, rc 0) 00000100:00100000:1.0:1788463748.472426:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+14:23359:x1875339485902848:12345-0@lo:101:mount.lustre.0 Request processed in 94us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463748.472433:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788463748.472655:0:23359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfeb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485902848:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788463748.472667:0:23359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff96188f6f5000/0x841acb7f42a3b277 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b27e expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463748.472676:0:23359:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff96188f6f5000/0x841acb7f42a3b277 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b27e expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463748.472687:0:23359:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788463748.472690:0:23359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5000/0x841acb7f42a3b277 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b27e expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463748.472697:0:23359:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff96188f6f5000/0x841acb7f42a3b277 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b27e expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463748.472703:0:23359:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788463748.472713:0:23359:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788463748.472717:0:23359:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff961787d22000 10000000:01000000:0.0:1788463748.472720:0:23359:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788463748.472723:0:23359:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788463748.472725:0:23359:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788463748.472739:0:23359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4a00/0x841acb7f42a3b285 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463748.472746:0:23359:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff96188f6f4a00/0x841acb7f42a3b285 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463748.472754:0:23359:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff96188f6f4a00/0x841acb7f42a3b285 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463748.472766:0:23359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfeb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485902976:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788463748.472790:0:23359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463748.472809:0:23359:0:(client.c:2716:ptlrpc_set_wait()) set ffff961885478c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788463748.472870:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485902976 00000100:00100000:3.0:1788463748.472875:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485902976 00000100:00100000:3.0:1788463748.472895:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788463748.472901:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+14:23359:x1875339485902976:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463748.472908:0:22620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463748.472917:0:22620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618be00ec00/0x841acb7f42a3b28c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b285 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.472930:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618be00ec00/0x841acb7f42a3b28c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b285 expref: 15 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.472939:0:22620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618be00ec00/0x841acb7f42a3b28c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b285 expref: 15 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.472945:0:22620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618be00ec00, rc 0) 00000100:00100000:3.0:1788463748.472981:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+15:23359:x1875339485902976:12345-0@lo:101:mount.lustre.0 Request processed in 80us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463748.472986:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788463748.473085:0:23359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfeb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485902976:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788463748.473095:0:23359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff96188f6f4a00/0x841acb7f42a3b285 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b28c expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463748.473104:0:23359:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff96188f6f4a00/0x841acb7f42a3b285 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b28c expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788463748.477553:0:23359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:0.0:1788463748.480440:0:23359:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788463748.492038:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788463748.492094:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:0.0:1788463748.492106:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:0.0:1788463748.492117:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:0.0:1788463748.492139:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:0.0:1788463748.492150:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:0.0:1788463748.492161:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:0.0:1788463748.492187:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:0.0:1788463748.492200:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:0.0:1788463748.492211:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:0.0:1788463748.492222:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:0.0:1788463748.492234:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:0.0:1788463748.492245:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:0.0:1788463748.492256:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:0.0:1788463748.492267:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:0.0:1788463748.492278:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:0.0:1788463748.492288:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:0.0:1788463748.492299:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:0.0:1788463748.492310:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:0.0:1788463748.492320:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:0.0:1788463748.492331:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:0.0:1788463748.492341:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:0.0:1788463748.492352:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:0.0:1788463748.492363:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:0.0:1788463748.492373:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:0.0:1788463748.492384:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:0.0:1788463748.492396:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:0.0:1788463748.492407:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:0.0:1788463748.492417:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:0.0:1788463748.492427:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:0.0:1788463748.492438:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:0.0:1788463748.492449:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:0.0:1788463748.492459:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:0.0:1788463748.492469:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:0.0:1788463748.492480:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:0.0:1788463748.492490:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:0.0:1788463748.492500:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:0.0:1788463748.492521:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:0.0:1788463748.492534:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:0.0:1788463748.492544:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:0.0:1788463748.492554:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:0.0:1788463748.492565:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:0.0:1788463748.492605:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:0.0:1788463748.492618:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:0.0:1788463748.492644:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:0.0:1788463748.492649:0:23359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:0.0:1788463748.492761:0:23359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfeb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485903104:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463748.492825:0:23359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463748.492865:0:23359:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787095540 going to sleep for 11 seconds 00000100:00100000:3.0:1788463748.493518:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485903104 00000100:00100000:3.0:1788463748.493531:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485903104 00000100:00100000:3.0:1788463748.493641:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788463748.493652:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+15:23359:x1875339485903104:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463748.493816:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+15:23359:x1875339485903104:12345-0@lo:501:mount.lustre.0 Request processed in 166us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463748.493825:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788463748.494197:0:23359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfeb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485903104:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463748.494238:0:23359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfeb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485903232:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788463748.494282:0:23359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463748.494356:0:23359:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787095540 going to sleep for 11 seconds 00000100:00100000:2.0:1788463748.503777:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485903232 00000100:00100000:2.0:1788463748.503795:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485903232 00000100:00100000:2.0:1788463748.503896:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788463748.503906:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+15:23359:x1875339485903232:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788463748.505187:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+15:23359:x1875339485903232:12345-0@lo:503:mount.lustre.0 Request processed in 1278us (10899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463748.505198:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788463748.505311:0:23359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfeb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485903232:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788463748.505817:0:23359:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788463748.505903:0:23359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfeb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485903360:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788463748.505951:0:23359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463748.505982:0:23359:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787095540 going to sleep for 11 seconds 00000100:00100000:1.0:1788463748.506104:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485903360 00000100:00100000:1.0:1788463748.506110:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485903360 00000100:00100000:1.0:1788463748.506152:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788463748.506160:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+15:23359:x1875339485903360:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788463748.507021:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+15:23359:x1875339485903360:12345-0@lo:502:mount.lustre.0 Request processed in 857us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463748.507030:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788463748.507228:0:23359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfeb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485903360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788463748.507489:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788463748.507523:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:2.0:1788463748.507536:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:2.0:1788463748.507547:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:2.0:1788463748.507559:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:2.0:1788463748.507571:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:2.0:1788463748.507620:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:2.0:1788463748.507634:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:2.0:1788463748.507647:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:2.0:1788463748.507661:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:2.0:1788463748.507674:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:2.0:1788463748.507685:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:2.0:1788463748.507696:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:2.0:1788463748.507709:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:2.0:1788463748.507721:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:2.0:1788463748.507733:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:2.0:1788463748.507746:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:2.0:1788463748.507762:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:2.0:1788463748.507775:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:2.0:1788463748.507810:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:2.0:1788463748.507827:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:2.0:1788463748.507839:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:2.0:1788463748.507851:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:2.0:1788463748.507863:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:2.0:1788463748.507876:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:2.0:1788463748.507888:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:2.0:1788463748.507913:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:2.0:1788463748.507925:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:2.0:1788463748.507937:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:2.0:1788463748.507948:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:2.0:1788463748.507959:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:2.0:1788463748.507971:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:2.0:1788463748.507983:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:2.0:1788463748.507996:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:2.0:1788463748.508007:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:2.0:1788463748.508030:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:2.0:1788463748.508044:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:2.0:1788463748.508056:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:2.0:1788463748.508068:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:2.0:1788463748.508080:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:2.0:1788463748.508091:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:2.0:1788463748.508103:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:2.0:1788463748.508115:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:2.0:1788463748.508130:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:2.0:1788463748.508179:0:23359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad769880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485903488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788463748.508238:0:23359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463748.508279:0:23359:0:(client.c:2716:ptlrpc_set_wait()) set ffff961886c2ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788463748.508437:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485903488 00000100:00100000:0.0:1788463748.508444:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485903488 00000100:00100000:0.0:1788463748.508494:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788463748.508503:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+15:23359:x1875339485903488:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788463748.508633:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+15:23359:x1875339485903488:12345-0@lo:502:mount.lustre.0 Request processed in 131us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463748.508651:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788463748.510785:0:23359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad769880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485903488:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788463748.510894:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1788463748.510908:0:23359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1788463748.522626:0:23363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463748.522649:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463748.522653:0:23363:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788463748.522661:0:23363:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788463748.522664:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788463748.522686:0:23363:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff96188fbd19c0) 00000020:00000080:0.0:1788463748.522711:0:23363:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1788463748.522717:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788463748.522832:0:23363:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788463748.522840:0:23363:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x841acb7f42a3b29a 00000020:00000080:0.0:1788463748.523066:0:23363:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788463748.523071:0:23363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463748.523075:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463748.523077:0:23363:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788463748.523079:0:23363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463748.523084:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463748.523085:0:23363:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788463748.523088:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788463748.523096:0:23363:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff96188fbd3380) 00000020:00000080:0.0:1788463748.523107:0:23363:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1788463748.523111:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788463748.523113:0:23363:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788463748.523116:0:23363:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788463748.523124:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788463748.523192:0:23363:0:(tgt_mount.c:153:server_get_mount()) get mount ffff961787d22000 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788463748.523203:0:23363:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff96188fbd4d40) 00000020:00000080:0.0:1788463748.523211:0:23363:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1788463748.523271:0:23363:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788463748.523277:0:23363:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x841acb7f42a3b2af 00000020:00000080:0.0:1788463748.523365:0:23363:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788463748.523371:0:23363:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788463748.523385:0:23363:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x841acb7f42a3b2b6 00080000:01000000:0.0:1788463748.523391:0:23363:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788463748.523395:0:23363:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x841acb7f42a3b2bd 00010000:00010000:2.0:1788463748.658023:0:23363:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788463748.658766:0:23363:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1788463748.659104:0:23363:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788463748.661693:0:23363:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788463748.661710:0:23363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463748.661719:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463748.661728:0:23363:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788463748.661733:0:23363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463748.661740:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463748.661742:0:23363:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788463748.661745:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788463748.661752:0:23363:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.153@tcp to nid 0x20000c0a8cc99 (192.168.204.153@tcp) 00000020:00000080:2.0:1788463748.661784:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788463748.661803:0:23363:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff96188d3a0000) 00000020:00000080:2.0:1788463748.661829:0:23363:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1788463748.661835:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788463748.661921:0:23363:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788463748.661929:0:23363:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788463748.661937:0:23363:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x841acb7f42a3b2cb 00010000:00080000:2.0:1788463748.661973:0:23363:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96188f997800@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.153@tcp at head 00010000:00010000:1.0:1788463748.667820:0:23363:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1788463748.669388:0:23363:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788463748.669406:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788463748.669444:0:23363:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788463748.669470:0:23363:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x841acb7f42a3b2d2 00000100:00080000:3.0:1788463748.669483:0:23363:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788463748.669490:0:23363:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff96188f997800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463748.669523:0:23363:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9618884f5500 x1875339485903616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788463748.669560:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485903616:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788463748.669688:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463748.669756:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485903616 00000100:00100000:3.0:1788463748.669763:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485903616 00000100:00100000:3.0:1788463748.669796:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788463748.669804:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875339485903616:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788463748.669828:0:22632:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 788 last 0 00000020:00000080:3.0:1788463748.669867:0:22632:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x841acb7f42a3b2d9 00000004:00100000:3.0:1788463748.670041:0:22632:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788463748.670049:0:22632:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:3.0:1788463748.670143:0:23363:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788463748.670216:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788463748.670220:0:1365:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788463748.670229:0:1365:0:(import.c:65:import_set_state_nolock()) ffff9618850d2000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788463748.670234:0:1365:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 786 00000100:00080000:3.0:1788463748.670237:0:1365:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788463748.670241:0:1365:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9618850d2000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463748.670257:0:1365:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9618884f4a80 x1875339485903872/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788463748.670271:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788463748.670275:0:1365:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788463748.670277:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788463748.670280:0:1365:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788463748.670307:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:abd83a7b-f7e3-4d68-aade-6298a66ab956:3650:1875339485903744:0@lo:400:kworker.0 00000100:00100000:3.0:1788463748.670344:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463748.670369:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463748.670375:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485904000:0@lo:400:kworker.0 00000100:00100000:3.0:1788463748.670406:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463748.670435:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485903744 00000100:00100000:3.0:1788463748.670440:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485903744 00000100:00100000:3.0:1788463748.670480:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788463748.670488:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+15:3650:x1875339485903744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463748.670537:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+15:3650:x1875339485903744:12345-0@lo:400:kworker.0 Request processed in 50us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463748.670544:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788463748.670619:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:abd83a7b-f7e3-4d68-aade-6298a66ab956:3650:1875339485903744:0@lo:400:kworker.0 00000100:00100000:3.0:1788463748.670719:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485903872:0@lo:38:kworker.0 00000100:00100000:3.0:1788463748.670767:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463748.670802:0:22631:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788463748.670812:0:22631:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788463748.670999:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485904000 00000100:00100000:2.0:1788463748.671005:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485904000 00000100:00100000:2.0:1788463748.671044:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788463748.671051:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485904000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463748.671097:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485904000:12345-0@lo:400:kworker.0 Request processed in 48us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463748.671105:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788463748.671134:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9618884f7100 x1875339485904000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463748.671146:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485904000:0@lo:400:kworker.0 00000020:01000000:3.0:1788463748.672320:0:23363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463748.672328:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463748.672330:0:23363:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788463748.672334:0:23363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788463748.672338:0:23363:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788463748.672340:0:23363:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788463748.672341:0:23363:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788463748.672343:0:23363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788463748.672346:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463748.672348:0:23363:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788463748.672351:0:23363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463748.672355:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463748.672357:0:23363:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788463748.672361:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788463748.672411:0:23363:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788463748.672427:0:23363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463748.672430:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463748.672431:0:23363:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788463748.672434:0:23363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788463748.672436:0:23363:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1788463748.672437:0:23363:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788463748.672439:0:23363:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788463748.672440:0:23363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788463748.672443:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463748.672444:0:23363:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788463748.672446:0:23363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788463748.672449:0:23363:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788463748.672453:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463748.672454:0:23363:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788463748.672457:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788463748.672461:0:23363:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.153@tcp to nid 0x20000c0a8cc99 (192.168.204.153@tcp) 00000020:01000000:3.0:1788463748.672491:0:23363:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788463748.672493:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788463748.672512:0:23363:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9617879099c0) 00000020:00000080:3.0:1788463748.672530:0:23363:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788463748.672536:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788463748.672654:0:23363:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788463748.672663:0:23363:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788463748.672671:0:23363:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x841acb7f42a3b2e7 00010000:00080000:3.0:1788463748.672704:0:23363:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96188d0ed800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.153@tcp at head 00010000:00010000:3.0:1788463748.673159:0:23363:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1788463748.673400:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485903872 00000100:00100000:0.0:1788463748.673411:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485903872 00000100:00100000:2.0:1788463748.673798:0:23368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788463748.673808:0:23368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3647:x1875339485903872:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788463748.673921:0:23368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3647:x1875339485903872:12345-0@lo:38:kworker.0 Request processed in 112us (3154us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788463748.673928:0:23368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788463748.674246:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788463748.674256:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9618850d2000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788463748.675026:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788463748.675032:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485903872:0@lo:38:kworker.0 00000040:01000000:2.0:1788463748.675747:0:23363:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788463748.676040:0:23363:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788463748.678888:0:23363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788463748.679110:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1788463748.679253:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788463748.683601:0:23369:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788463748.683610:0:23369:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00080000:0.0:1788463748.686868:0:22632:0:(import.c:65:import_set_state_nolock()) ffff961885e44000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788463748.686986:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1875339485903616:12345-0@lo:38:llog_process_th.0 Request processed in 17179us (17296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463748.686997:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788463748.687189:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788463748.687200:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788463748.687210:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788463748.687216:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788463748.687220:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188f997800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788463748.687240:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485903616:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788463748.687721:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485904128:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463748.687779:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463748.687917:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485904128 00000100:00100000:2.0:1788463748.687924:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485904128 00000100:00100000:2.0:1788463748.687976:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788463748.687986:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1875339485904128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788463748.688020:0:22631:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788463748.691771:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1875339485904128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3773us (3979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463748.691780:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485904128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463748.691791:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000020:00000080:0.0:1788463748.695898:0:23363:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788463748.695914:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788463748.695964:0:23363:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788463748.695987:0:23363:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x841acb7f42a3b2ee 00000100:00080000:0.0:1788463748.695997:0:23363:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788463748.696003:0:23363:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff96188d0ed800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:0.0:1788463748.696038:0:23363:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188cfe8a80 x1875339485904256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788463748.696100:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfe8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485904256:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788463748.696156:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875339485904256 offset 0 length 520: 4 00000100:00080000:0.0:1788463748.696220:0:23363:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788463748.696329:0:23363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463748.696332:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463748.696334:0:23363:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788463748.696337:0:23363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788463748.696339:0:23363:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1788463748.696341:0:23363:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788463748.696343:0:23363:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788463748.696344:0:23363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788463748.696346:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463748.696347:0:23363:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788463748.696349:0:23363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788463748.696365:0:23363:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788463748.696368:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463748.696369:0:23363:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788463748.696372:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788463748.696375:0:23363:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.153@tcp to nid 0x20000c0a8cc99 (192.168.204.153@tcp) 00000020:01000000:0.0:1788463748.696394:0:23363:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788463748.696396:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788463748.696409:0:23363:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9618831e0000) 00000020:00000080:0.0:1788463748.696421:0:23363:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1788463748.696425:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788463748.696515:0:23363:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1788463748.696523:0:23363:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788463748.696531:0:23363:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x841acb7f42a3b2fc 00010000:00080000:0.0:1788463748.696565:0:23363:0:(ldlm_lib.c:102:import_set_conn()) imp ffff961882e02800@lustre-OST0001-osc-MDT0001: add connection 192.168.204.153@tcp at head 00010000:00010000:0.0:1788463748.696784:0:23363:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788463748.696861:0:23363:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788463748.696878:0:23363:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1788463748.697413:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788463748.697420:0:1365:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788463748.697423:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788463748.697427:0:1365:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1788463748.698459:0:23363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788463748.698838:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1788463748.698963:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1788463748.700939:0:23371:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788463748.700948:0:23371:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788463748.701790:0:23363:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788463748.701805:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788463748.701847:0:23363:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788463748.701872:0:23363:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x841acb7f42a3b303 00000100:00080000:1.0:1788463748.701885:0:23363:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788463748.701891:0:23363:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff961882e02800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:1.0:1788463748.701930:0:23363:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188d1d0700 x1875339485904384/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788463748.701963:0:23363:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788463748.702016:0:23363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463748.702020:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463748.702022:0:23363:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788463748.702026:0:23363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788463748.702030:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463748.702031:0:23363:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788463748.702034:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788463748.702035:0:23363:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788463748.702038:0:23363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463748.702040:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463748.702042:0:23363:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788463748.702044:0:23363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788463748.702045:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463748.702046:0:23363:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788463748.702049:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788463748.702075:0:23363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463748.702078:0:23363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463748.702079:0:23363:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788463748.702082:0:23363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:0.0:1788463748.702326:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463748.702331:0:1365:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788463748.702334:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463748.702337:0:1365:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788463748.702616:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485904384:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788463748.702692:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875339485904384 offset 0 length 520: 4 00000020:01000000:0.0:1788463748.702813:0:23359:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1788463748.702846:0:23359:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788463748.702861:0:23359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4a00/0x841acb7f42a3b285 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b28c expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463748.702883:0:23359:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff96188f6f4a00/0x841acb7f42a3b285 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b28c expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463748.702892:0:23359:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff961787d22000 from 1 10000000:01000000:0.0:1788463748.702895:0:23359:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788463748.702923:0:23359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5400/0x841acb7f42a3b30a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463748.702931:0:23359:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff96188f6f5400/0x841acb7f42a3b30a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463748.702941:0:23359:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff96188f6f5400/0x841acb7f42a3b30a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463748.702958:0:23359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfe9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485904512:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788463748.702994:0:23359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463748.703020:0:23359:0:(client.c:2716:ptlrpc_set_wait()) set ffff961885478c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788463748.703266:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485904512 00000100:00100000:1.0:1788463748.703273:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485904512 00000100:00100000:1.0:1788463748.703332:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788463748.703341:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+15:23359:x1875339485904512:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788463748.703356:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463748.703369:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961786bdf800/0x841acb7f42a3b311 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b30a expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463748.703392:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961786bdf800/0x841acb7f42a3b311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b30a expref: 16 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463748.703403:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961786bdf800/0x841acb7f42a3b311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b30a expref: 16 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463748.703411:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdf800, rc 0) 00000100:00100000:1.0:1788463748.703449:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+16:23359:x1875339485904512:12345-0@lo:101:mount.lustre.0 Request processed in 109us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463748.703467:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788463748.703649:0:23359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfe9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485904512:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788463748.703664:0:23359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff96188f6f5400/0x841acb7f42a3b30a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b311 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463748.703673:0:23359:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff96188f6f5400/0x841acb7f42a3b30a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b311 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463748.704255:0:23359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfe9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485904640:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788463748.704306:0:23359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463748.704338:0:23359:0:(client.c:2716:ptlrpc_set_wait()) set ffff961885478c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788463748.704703:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485904640 00000100:00100000:3.0:1788463748.704711:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485904640 00000100:00100000:3.0:1788463748.704793:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788463748.704804:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+16:23359:x1875339485904640:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788463748.704824:0:22618:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788463748.704845:0:22618:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788463748.704848:0:22618:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1788463748.704943:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+16:23359:x1875339485904640:12345-0@lo:256:mount.lustre.0 Request processed in 140us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463748.704955:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788463748.705024:0:23359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfe9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485904640:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788463748.705660:0:23359:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788463748.705675:0:23359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5400/0x841acb7f42a3b30a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b311 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463748.705685:0:23359:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff96188f6f5400/0x841acb7f42a3b30a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b311 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463748.705694:0:23359:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff961787d22000 from 1 10000000:01000000:0.0:1788463748.705696:0:23359:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788463748.705723:0:23359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a3b318 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463748.705731:0:23359:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a3b318 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463748.705740:0:23359:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a3b318 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463748.705756:0:23359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfe9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485904768:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788463748.705792:0:23359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463748.706097:0:23359:0:(client.c:2716:ptlrpc_set_wait()) set ffff961885478c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788463748.706190:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485904768 00000100:00100000:1.0:1788463748.706199:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485904768 00000100:00100000:1.0:1788463748.706239:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788463748.706249:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+16:23359:x1875339485904768:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788463748.706261:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463748.706275:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961786bdec00/0x841acb7f42a3b31f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b318 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463748.706297:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961786bdec00/0x841acb7f42a3b31f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b318 expref: 17 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463748.706307:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961786bdec00/0x841acb7f42a3b31f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b318 expref: 17 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463748.706330:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdec00, rc 0) 00000100:00100000:1.0:1788463748.706415:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+17:23359:x1875339485904768:12345-0@lo:101:mount.lustre.0 Request processed in 167us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463748.706421:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788463748.706555:0:23359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfe9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485904768:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788463748.706570:0:23359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a3b318 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b31f expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463748.706611:0:23359:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a3b318 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b31f expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788463748.708123:0:23359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:0.0:1788463748.708469:0:23359:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788463748.708793:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788463748.708819:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1788463748.708833:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1788463748.708846:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1788463748.708859:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1788463748.708872:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1788463748.708886:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1788463748.708900:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:0.0:1788463748.708912:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788463748.708923:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:0.0:1788463748.708936:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:0.0:1788463748.708953:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:0.0:1788463748.708958:0:23359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:0.0:1788463748.709026:0:23359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfe9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485904896:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463748.709078:0:23359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463748.709174:0:23359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618811ca480 going to sleep for 11 seconds 00000100:00100000:2.0:1788463748.709295:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485904896 00000100:00100000:2.0:1788463748.709310:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485904896 00000100:00100000:1.0:1788463748.709371:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788463748.709384:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+17:23359:x1875339485904896:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463748.709565:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+17:23359:x1875339485904896:12345-0@lo:501:mount.lustre.0 Request processed in 183us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463748.709593:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788463748.709700:0:23359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfe9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485904896:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463748.709731:0:23359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfe9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485905024:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788463748.709772:0:23359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463748.709791:0:23359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618811ca480 going to sleep for 11 seconds 00000100:00100000:3.0:1788463748.709849:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485905024 00000100:00100000:3.0:1788463748.709854:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485905024 00000100:00100000:3.0:1788463748.709888:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788463748.709895:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+17:23359:x1875339485905024:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788463748.709976:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+17:23359:x1875339485905024:12345-0@lo:503:mount.lustre.0 Request processed in 81us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463748.709982:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788463748.710084:0:23359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfe9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485905024:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788463748.710530:0:23359:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788463748.710699:0:23359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfe9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485905152:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788463748.710741:0:23359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463748.710776:0:23359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618811ca480 going to sleep for 11 seconds 00000100:00100000:3.0:1788463748.710836:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485905152 00000100:00100000:3.0:1788463748.710842:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485905152 00000100:00100000:3.0:1788463748.710877:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788463748.710887:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+17:23359:x1875339485905152:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463748.710973:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+17:23359:x1875339485905152:12345-0@lo:502:mount.lustre.0 Request processed in 87us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463748.710981:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788463748.711161:0:23359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfe9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485905152:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788463748.711560:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788463748.711675:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:0.0:1788463748.711689:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:0.0:1788463748.711699:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:0.0:1788463748.711710:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:0.0:1788463748.711720:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:0.0:1788463748.711730:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:0.0:1788463748.711740:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:0.0:1788463748.711751:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788463748.711761:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:0.0:1788463748.711772:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:0.0:1788463748.711794:0:23359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfe9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485905280:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788463748.711834:0:23359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463748.711855:0:23359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618811ca480 going to sleep for 11 seconds 00000100:00100000:3.0:1788463748.711907:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485905280 00000100:00100000:3.0:1788463748.711912:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485905280 00000100:00100000:3.0:1788463748.711973:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788463748.711981:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+17:23359:x1875339485905280:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463748.712055:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+17:23359:x1875339485905280:12345-0@lo:502:mount.lustre.0 Request processed in 74us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463748.712061:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788463748.712227:0:23359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfe9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485905280:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788463748.712266:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:0.0:1788463748.712273:0:23359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788463748.713022:0:23373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463748.713034:0:23373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463748.713037:0:23373:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788463748.713047:0:23373:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff961787d22000 00000020:00000080:3.0:1788463748.713055:0:23373:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788463748.713064:0:23373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463748.713074:0:23373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463748.713075:0:23373:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788463748.713078:0:23373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463748.713081:0:23373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463748.713082:0:23373:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788463748.713085:0:23373:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff961787d22000 00000020:00000080:3.0:1788463748.713086:0:23373:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788463748.713205:0:23373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463748.713210:0:23373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463748.713211:0:23373:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788463748.713214:0:23373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463748.713217:0:23373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463748.713218:0:23373:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788463748.713222:0:23373:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff961787d22000 00000020:00000080:3.0:1788463748.713224:0:23373:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788463748.713671:0:23373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463748.713677:0:23373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463748.713678:0:23373:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788463748.713681:0:23373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463748.713684:0:23373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463748.713685:0:23373:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788463748.713688:0:23373:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff961787d22000 00000020:00000080:3.0:1788463748.713690:0:23373:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788463748.713716:0:23373:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463748.713719:0:23373:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463748.713720:0:23373:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788463748.713723:0:23373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:1.0:1788463748.722698:0:23359:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788463748.722749:0:23359:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788463748.722780:0:23359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a3b318 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b31f expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463748.722793:0:23359:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a3b318 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b31f expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463748.722884:0:23359:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788463748.722888:0:23359:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff961787d22000 10000000:01000000:1.0:1788463748.722891:0:23359:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff961787d22000 10000000:01000000:1.0:1788463748.722894:0:23359:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788463748.722900:0:23359:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff961787d22000 from 1 10000000:01000000:1.0:1788463748.722902:0:23359:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788463748.722941:0:23359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bde600/0x841acb7f42a3b326 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463748.722950:0:23359:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961786bde600/0x841acb7f42a3b326 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463748.722970:0:23359:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961786bde600/0x841acb7f42a3b326 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463748.722998:0:23359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485905408:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788463748.723068:0:23359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463748.723110:0:23359:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787095240 going to sleep for 11 seconds 00000100:00100000:2.0:1788463748.724352:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485905408 00000100:00100000:2.0:1788463748.724367:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485905408 00000100:00100000:2.0:1788463748.724429:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788463748.724439:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+17:23359:x1875339485905408:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788463748.724601:0:22620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463748.724624:0:22620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961785e20800/0x841acb7f42a3b32d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b326 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463748.724655:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961785e20800/0x841acb7f42a3b32d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b326 expref: 18 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463748.724667:0:22620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961785e20800/0x841acb7f42a3b32d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b326 expref: 18 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463748.724676:0:22620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20800, rc 0) 00000100:00100000:2.0:1788463748.724744:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:23359:x1875339485905408:12345-0@lo:101:mount.lustre.0 Request processed in 307us (1676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463748.724752:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788463748.724811:0:23359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485905408:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788463748.724830:0:23359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961786bde600/0x841acb7f42a3b326 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b32d expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463748.724839:0:23359:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961786bde600/0x841acb7f42a3b326 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b32d expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788463748.731062:0:23359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1788463748.731471:0:23359:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788463748.734983:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1788463748.735024:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:0.0:1788463748.735041:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:0.0:1788463748.735057:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:0.0:1788463748.735073:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:0.0:1788463748.735088:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:0.0:1788463748.735102:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:0.0:1788463748.735116:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:0.0:1788463748.735128:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:0.0:1788463748.735157:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:0.0:1788463748.735185:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:0.0:1788463748.735208:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:0.0:1788463748.735222:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:0.0:1788463748.735235:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:0.0:1788463748.735248:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:0.0:1788463748.735260:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:0.0:1788463748.735273:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:0.0:1788463748.735286:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:0.0:1788463748.735300:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:0.0:1788463748.735314:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:0.0:1788463748.735327:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:0.0:1788463748.735341:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:0.0:1788463748.735356:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:0.0:1788463748.735371:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:0.0:1788463748.735386:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:0.0:1788463748.735416:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:0.0:1788463748.735433:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:0.0:1788463748.735446:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:0.0:1788463748.735458:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:0.0:1788463748.735469:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:0.0:1788463748.735480:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:0.0:1788463748.735492:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:0.0:1788463748.735504:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:0.0:1788463748.735532:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:0.0:1788463748.735550:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:0.0:1788463748.735565:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:0.0:1788463748.735624:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:0.0:1788463748.735641:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:0.0:1788463748.735653:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:0.0:1788463748.735664:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:0.0:1788463748.735675:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:0.0:1788463748.735701:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:0.0:1788463748.735717:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:0.0:1788463748.735731:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:0.0:1788463748.735756:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:0.0:1788463748.735772:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:0.0:1788463748.735786:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:0.0:1788463748.735801:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:0.0:1788463748.735933:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:0.0:1788463748.735955:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:0.0:1788463748.735973:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:0.0:1788463748.735978:0:23359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:0.0:1788463748.736107:0:23359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfe9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485905536:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463748.736200:0:23359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463748.736255:0:23359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618811ca780 going to sleep for 11 seconds 00000100:00100000:0.0:1788463748.736694:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485905536 00000100:00100000:0.0:1788463748.736703:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485905536 00000100:00100000:0.0:1788463748.736800:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788463748.736811:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:23359:x1875339485905536:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463748.736957:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:23359:x1875339485905536:12345-0@lo:501:mount.lustre.0 Request processed in 148us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463748.736967:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788463748.737649:0:23359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfe9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485905536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463748.737702:0:23359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485905664:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788463748.737764:0:23359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463748.738096:0:23359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618811ca780 going to sleep for 11 seconds 00000100:00100000:2.0:1788463748.738135:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485905664 00000100:00100000:2.0:1788463748.738148:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485905664 00000100:00100000:2.0:1788463748.738193:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788463748.738203:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:23359:x1875339485905664:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788463748.738350:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:23359:x1875339485905664:12345-0@lo:503:mount.lustre.0 Request processed in 147us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463748.738357:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788463748.739490:0:23359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485905664:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788463748.740218:0:23359:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788463748.744620:0:23359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485905792:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788463748.744711:0:23359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463748.744761:0:23359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618812edc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788463748.745375:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889fc9180 going to sleep for 0 seconds 00000100:00100000:3.0:1788463748.746436:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485905792 00000100:00100000:3.0:1788463748.746461:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485905792 00000100:00100000:3.0:1788463748.746546:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788463748.746557:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:23359:x1875339485905792:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463748.746772:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:23359:x1875339485905792:12345-0@lo:502:mount.lustre.0 Request processed in 216us (2062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463748.746781:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788463748.746851:0:23359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485905792:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788463748.747140:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1788463748.747187:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1788463748.747202:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1788463748.747214:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1788463748.747227:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1788463748.747239:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1788463748.747253:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1788463748.747268:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1788463748.747284:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1788463748.747300:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1788463748.747317:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1788463748.747333:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1788463748.747349:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1788463748.747388:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1788463748.747407:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1788463748.747422:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1788463748.747437:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1788463748.747450:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1788463748.747466:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1788463748.747482:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1788463748.747505:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1788463748.747524:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1788463748.747540:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1788463748.747556:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1788463748.747570:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1788463748.747719:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1788463748.747748:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1788463748.747767:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1788463748.747783:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1788463748.747812:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1788463748.747826:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1788463748.747839:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1788463748.747853:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1788463748.747867:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1788463748.747883:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1788463748.747896:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1788463748.747910:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1788463748.747924:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1788463748.747937:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1788463748.747952:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1788463748.747970:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1788463748.747992:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1788463748.748010:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1788463748.748029:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1788463748.748049:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1788463748.748081:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1788463748.748100:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1788463748.748117:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1788463748.748176:0:23359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485905920:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463748.748236:0:23359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463748.748281:0:23359:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fa1e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463748.748601:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485905920 00000100:00100000:1.0:1788463748.748608:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485905920 00000100:00100000:1.0:1788463748.748656:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788463748.748667:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:23359:x1875339485905920:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788463748.748795:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:23359:x1875339485905920:12345-0@lo:502:mount.lustre.0 Request processed in 130us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463748.748804:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788463748.749799:0:23359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485905920:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788463748.750032:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:3.0:1788463748.750060:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:3.0:1788463748.750095:0:23359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485906048:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463748.750150:0:23359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463748.750846:0:23359:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fa1e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463748.750895:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485906048 00000100:00100000:2.0:1788463748.750903:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485906048 00000100:00100000:2.0:1788463748.750962:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788463748.750971:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e69bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:23359:x1875339485906048:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788463748.751093:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e69bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:23359:x1875339485906048:12345-0@lo:502:mount.lustre.0 Request processed in 122us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463748.751100:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788463748.751206:0:23359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485906048:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788463748.751326:0:23359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:3.0:1788463748.751341:0:23359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788463748.752504:0:23378:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788463748.752520:0:23378:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff96178790b380) 00000020:00000080:3.0:1788463748.752543:0:23378:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788463748.752812:0:23378:0:(tgt_mount.c:153:server_get_mount()) get mount ffff961787d22000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788463748.752817:0:23378:0:(tgt_mount.c:187:server_put_mount()) put mount ffff961787d22000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788463748.752820:0:23378:0:(obd_mount.c:710:lustre_put_lsi()) put ffff961787d22000 3 00010000:00080000:3.0:1788463748.752856:0:23378:0:(ldlm_lib.c:102:import_set_conn()) imp ffff961886dd8800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.153@tcp at head 00010000:00010000:3.0:1788463748.756473:0:23378:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1788463748.757899:0:23378:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788463748.757956:0:23378:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788463748.757970:0:23378:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x841acb7f42a3b33b 00000100:00080000:3.0:1788463748.757983:0:23378:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788463748.757990:0:23378:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff961886dd8800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463748.758030:0:23378:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9618884f4a80 x1875339485906176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788463748.758058:0:23378:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788463748.758088:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788463748.758092:0:1365:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788463748.758095:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788463748.758099:0:1365:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788463748.758314:0:23378:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:1.0:1788463748.758630:0:23359:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788463748.758662:0:23359:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788463748.758680:0:23359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bde600/0x841acb7f42a3b326 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b32d expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463748.758690:0:23359:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961786bde600/0x841acb7f42a3b326 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b32d expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788463748.758743:0:23359:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788463748.758745:0:23359:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788463748.758746:0:23359:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788463748.758747:0:23359:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788463748.758749:0:23359:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788463748.758750:0:23359:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788463748.758751:0:23359:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788463748.758754:0:23359:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788463748.758755:0:23359:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788463748.758759:0:23359:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1788463748.758762:0:23359:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788463748.758763:0:23359:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788463748.758765:0:23359:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788463748.758766:0:23359:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788463748.758767:0:23359:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788463748.758768:0:23359:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788463748.758769:0:23359:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788463748.758770:0:23359:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788463748.758771:0:23359:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788463748.758789:0:23359:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788463748.758805:0:23359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485906304:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788463748.758874:0:23359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463748.758909:0:23359:0:(client.c:2716:ptlrpc_set_wait()) set ffff961888e26000 going to sleep for 11 seconds 00000100:00100000:2.0:1788463748.759004:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875339485906176:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788463748.759049:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463748.759095:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485906176 00000100:00100000:2.0:1788463748.759102:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485906176 00000100:00100000:2.0:1788463748.759134:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788463748.759141:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875339485906176:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788463748.759177:0:22627:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 788 last 0 00000020:00000080:2.0:1788463748.759215:0:22627:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x841acb7f42a3b342 00000004:00100000:2.0:1788463748.759232:0:22627:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788463748.759277:0:22627:0:(import.c:65:import_set_state_nolock()) ffff96188d10e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788463748.759337:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875339485906176:12345-0@lo:38:llog_process_th.0 Request processed in 194us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463748.759354:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788463748.759441:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485906304 00000100:00100000:3.0:1788463748.759446:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485906304 00000100:00100000:3.0:1788463748.759493:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788463748.759499:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e699850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:23359:x1875339485906304:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788463748.759522:0:22620:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788463748.759535:0:22620:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1788463748.760022:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9618884f4a80 x1875339485906176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788463758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463748.760034:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788463748.760043:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788463748.760052:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788463748.760057:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788463748.760060:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961886dd8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788463748.760066:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875339485906176:0@lo:38:llog_process_th.0 00000001:00100000:3.0:1788463748.764943:0:22605:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788463748.764984:0:22620:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788463748.765005:0:22620:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788463748.765099:0:22642:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788463748.765105:0:22642:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788463748.765129:0:22642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff961786bde000/0x841acb7f42a3b349 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463748.765150:0:22642:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9618be00fe00/0x841acb7f42a3b24d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b246 expref: 18 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463748.765183:0:22642:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961786bdf800/0x841acb7f42a3b311 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b30a expref: 18 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463748.765195:0:22642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff961786bde000/0x841acb7f42a3b349 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463748.765238:0:22642:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961786bdf800/0x841acb7f42a3b311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3b30a expref: 18 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463748.765253:0:22642:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff961786bdf800/0x841acb7f42a3b311 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3b30a expref: 18 pid: 22621 timeout: 888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463748.765324:0:22642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22642:1875339485906432:0@lo:104: 00000100:00100000:1.0:1788463748.765400:0:22642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788463748.765454:0:22642:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9618be00fe00/0x841acb7f42a3b24d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3b246 expref: 18 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463748.765462:0:22642:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9618be00fe00/0x841acb7f42a3b24d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3b246 expref: 18 pid: 22621 timeout: 888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463748.765470:0:22642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22642:1875339485906560:0@lo:104: 00000100:00100000:1.0:1788463748.765490:0:22642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463748.765516:0:22642:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188d131840 going to sleep for 11 seconds 00000100:00100000:3.0:1788463748.765568:0:22609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485906432 00000100:00100000:3.0:1788463748.765601:0:22609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485906432 00000100:00100000:2.0:1788463748.765621:0:22610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485906560 00000100:00100000:2.0:1788463748.765625:0:22610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485906560 00000100:00100000:3.0:1788463748.765642:0:22609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788463748.765651:0:22609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:abd83a7b-f7e3-4d68-aade-6298a66ab956+4:22642:x1875339485906432:12345-0@lo:104: 00010000:00010000:3.0:1788463748.765665:0:22609:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff96188f6f5400/0x841acb7f42a3b30a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3b311 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.765994:0:22609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788463748.766002:0:22609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:abd83a7b-f7e3-4d68-aade-6298a66ab956+4:22642:x1875339485906432:12345-0@lo:104: Request processed in 351us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463748.766230:0:22609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788463748.766255:0:22609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788463748.766367:0:22642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22642:1875339485906432:0@lo:104: 00000100:00100000:3.0:1788463748.766407:0:22609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:abd83a7b-f7e3-4d68-aade-6298a66ab956+3:22642:x1875339485906560:12345-0@lo:104: 00010000:00010000:3.0:1788463748.766417:0:22609:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b246 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3b24d expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.766467:0:22609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788463748.766473:0:22609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:abd83a7b-f7e3-4d68-aade-6298a66ab956+3:22642:x1875339485906560:12345-0@lo:104: Request processed in 70us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463748.766485:0:22609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788463748.766508:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788463748.766519:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff96188f6f5400/0x841acb7f42a3b30a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3b311 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.766526:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5400 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:3.0:1788463748.766530:0:22614:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f5400/0x841acb7f42a3b30a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3b311 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.766543:0:22614:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff96188f6f5400/0x841acb7f42a3b30a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3b311 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463748.766551:0:22614:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f5400/0x841acb7f42a3b30a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3b311 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463748.766556:0:22614:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788463748.766611:0:22614:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff96188f6f5400/0x841acb7f42a3b30a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b311 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.766618:0:22614:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463748.766640:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff96188f6f5400/0x841acb7f42a3b30a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b311 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.766647:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff96188f6f5400/0x841acb7f42a3b30a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b311 expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.766657:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463748.766661:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b246 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3b24d expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.766666:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21200 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:3.0:1788463748.766669:0:22614:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b246 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3b24d expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.766687:0:22614:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3b24d expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463748.766694:0:22614:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3b24d expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463748.766699:0:22614:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1788463748.766857:0:22642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22642:1875339485906560:0@lo:104: 00010000:00010000:1.0:1788463748.766884:0:22642:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff961786bde000/0x841acb7f42a3b349 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463748.766984:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e699850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:23359:x1875339485906304:12345-0@lo:253:mount.lustre.0 Request processed in 7483us (8108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463748.766994:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:3.0:1788463748.767062:0:22614:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b246 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b24d expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.767068:0:22614:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463748.767086:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b246 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b24d expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.767093:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b246 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b24d expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.767105:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463748.767107:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463748.767108:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463748.767115:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463748.767128:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:abd83a7b-f7e3-4d68-aade-6298a66ab956:3649:1875339485906688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463748.767160:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463748.767218:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788463748.767226:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:abd83a7b-f7e3-4d68-aade-6298a66ab956:3651:1875339485906816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463748.767250:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463748.767337:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485906688 00000100:00100000:3.0:1788463748.767343:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485906688 00010000:00010000:3.0:1788463748.767371:0:22611:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961786bdf800/0x841acb7f42a3b311 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3b30a expref: 18 pid: 22621 timeout: 888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463748.767393:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485906816 00000100:00100000:3.0:1788463748.767397:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485906816 00010000:00010000:3.0:1788463748.767407:0:22611:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9618be00fe00/0x841acb7f42a3b24d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3b246 expref: 19 pid: 22621 timeout: 888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463748.767420:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788463748.767426:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:abd83a7b-f7e3-4d68-aade-6298a66ab956+19:3649:x1875339485906688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463748.767436:0:22611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463748.767441:0:22611:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961786bdf800/0x841acb7f42a3b311 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3b30a expref: 19 pid: 22621 timeout: 888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.767452:0:22611:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961786bdf800/0x841acb7f42a3b311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3b30a expref: 19 pid: 22621 timeout: 888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.767470:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961786bdf800/0x841acb7f42a3b311 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3b30a expref: 19 pid: 22621 timeout: 888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.767483:0:22611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463748.767511:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:3649:x1875339485906688:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463748.767518:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788463748.767530:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788463748.767537:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:abd83a7b-f7e3-4d68-aade-6298a66ab956+17:3651:x1875339485906816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463748.767544:0:22611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463748.767548:0:22611:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9618be00fe00/0x841acb7f42a3b24d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3b246 expref: 17 pid: 22621 timeout: 888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463748.767556:0:23359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:23359:1875339485906304:0@lo:253:mount.lustre.0 00010000:00010000:3.0:1788463748.767566:0:22611:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9618be00fe00/0x841acb7f42a3b24d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3b246 expref: 17 pid: 22621 timeout: 888 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463748.767568:0:23359:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788463748.767571:0:23359:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788463748.767591:0:23359:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788463748.767592:0:23359:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00010000:00010000:3.0:1788463748.767594:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618be00fe00/0x841acb7f42a3b24d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3b246 expref: 17 pid: 22621 timeout: 888 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788463748.767594:0:23359:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788463748.767595:0:23359:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788463748.767597:0:23359:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788463748.767598:0:23359:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788463748.767600:0:23359:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788463748.767602:0:23359:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:3.0:1788463748.767606:0:22611:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff961786bde000/0x841acb7f42a3b349 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.767613:0:22611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961786bde000/0x841acb7f42a3b349 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:1.0:1788463748.767614:0:23359:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788463748.767627:0:22611:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014293953s 00010000:00010000:3.0:1788463748.767632:0:22611:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961786bde000/0x841acb7f42a3b349 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.767638:0:22611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961786bde000/0x841acb7f42a3b349 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.767645:0:22611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff961786bde000/0x841acb7f42a3b349 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.767651:0:22611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff961786bde000/0x841acb7f42a3b349 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.767657:0:22611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463748.767661:0:22611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff961786bde000/0x841acb7f42a3b349 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.767667:0:22611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff961786bde000/0x841acb7f42a3b349 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.767690:0:22611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff961786bde000/0x841acb7f42a3b349 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.767700:0:22611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463748.767724:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:abd83a7b-f7e3-4d68-aade-6298a66ab956+16:3651:x1875339485906816:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463748.767730:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788463748.767758:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:abd83a7b-f7e3-4d68-aade-6298a66ab956:3651:1875339485906816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463748.767775:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:abd83a7b-f7e3-4d68-aade-6298a66ab956:3649:1875339485906688:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463748.767789:0:22642:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff961786bde000/0x841acb7f42a3b349 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.767796:0:22642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff961786bde000/0x841acb7f42a3b349 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463748.767803:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961786bde000/0x841acb7f42a3b349 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:0.0:1788463748.771721:0:23359:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1788463748.771724:0:23384:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788463748.771730:0:23384:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788463748.772047:0:23385:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788463748.772288:0:23359:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1788463748.772850:0:23385:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788463748.773506:0:23386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f5180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23386:1875339485906944:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788463748.773609:0:23386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463748.773651:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485906944 00000100:00100000:3.0:1788463748.773658:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485906944 00000100:00100000:3.0:1788463748.773705:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788463748.773713:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23386:x1875339485906944:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788463748.773788:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23386:x1875339485906944:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 75us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463748.773803:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788463748.773825:0:23386:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fa1e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463748.773849:0:23386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f5180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23386:1875339485906944:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788463748.773877:0:23386:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788463748.773900:0:23386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f5180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23386:1875339485907072:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788463748.773925:0:23386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463748.773943:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485907072 00000100:00100000:3.0:1788463748.773946:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485907072 00000100:00100000:3.0:1788463748.773963:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788463748.773968:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23386:x1875339485907072:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788463748.774046:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23386:x1875339485907072:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 77us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463748.774051:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788463748.774065:0:23386:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fa1e900 going to sleep for 11 seconds 00000100:00100000:3.0:1788463748.774076:0:23386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f5180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23386:1875339485907072:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788463748.774117:0:23386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f5180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23386:1875339485907200:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788463748.774142:0:23386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463748.774189:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485907200 00000100:00100000:3.0:1788463748.774193:0:22637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485907200 00000100:00100000:3.0:1788463748.774216:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788463748.774222:0:22637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23386:x1875339485907200:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788463748.774252:0:22637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23386:x1875339485907200:12345-0@lo:900:lod0001_rec0000.0 Request processed in 32us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463748.774271:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788463748.774292:0:23386:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e03c0 going to sleep for 11 seconds 00010000:00080000:3.0:1788463748.774308:0:23386:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9618884f5180 x1875339485907200/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788463764 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463748.774319:0:23386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f5180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23386:1875339485907200:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788463748.774350:0:23386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f5180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23386:1875339485907328:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788463748.774371:0:23386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463748.774386:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485907328 00000100:00100000:3.0:1788463748.774388:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485907328 00000100:00100000:3.0:1788463748.774404:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788463748.774408:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23386:x1875339485907328:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788463748.774443:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23386:x1875339485907328:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 34us (71us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463748.774448:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788463748.774460:0:23386:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188688ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788463748.774470:0:23386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f5180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23386:1875339485907328:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788463748.774504:0:23386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1788463748.776767:0:23359:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788463748.776822:0:23359:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788463748.778186:0:23385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000040:00080000:3.0:1788463748.778218:0:23386:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788463748.778386:0:23385:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00000080:2.0:1788463748.778689:0:23359:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788463748.778705:0:23359:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788463748.778797:0:23359:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788463748.779366:0:23386:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788463748.779371:0:23386:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:2.0:1788463748.780934:0:23359:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788463748.782139:0:23359:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788463748.782211:0:23359:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1788463748.782464:0:23359:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788463748.783098:0:23359:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:0.0:1788463748.786271:0:23359:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1788463748.793013:0:23359:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788463748.793058:0:23359:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffba474145b988 00100000:10000000:0.0:1788463748.793068:0:23359:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1788463748.797089:0:23359:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788463748.797127:0:23359:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.153@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788463748.797146:0:23359:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788463748.797174:0:23359:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788463748.803069:0:23359:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788463748.803338:0:23359:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788463749.124062:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463749.763656:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889fc9180 going to sleep for 0 seconds 00000040:00080000:1.0:1788463749.831442:0:23381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788463750.147954:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788463750.667496:0:22623:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788463750.667505:0:22623:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff961787d22000 from 12 10000000:01000000:3.0:1788463750.667511:0:22623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788463750.667561:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618be00fe00/0x841acb7f42a3b350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463750.667619:0:22623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff9618be00fe00/0x841acb7f42a3b350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463750.667630:0:22623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff9618be00fe00/0x841acb7f42a3b350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463750.667666:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485907456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788463750.667789:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463750.667833:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff961883659a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788463750.668531:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485907456 00000100:00100000:2.0:1788463750.668540:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485907456 00000100:00100000:2.0:1788463750.668614:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788463750.668624:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e69b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+16:22623:x1875339485907456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463750.668638:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463750.668662:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961785e21e00/0x841acb7f42a3b357 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b350 expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463750.668687:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961785e21e00/0x841acb7f42a3b357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b350 expref: 17 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463750.668709:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961785e21e00/0x841acb7f42a3b357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b350 expref: 17 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463750.668719:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e21e00, rc 0) 00000100:00100000:2.0:1788463750.668769:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e69b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+17:22623:x1875339485907456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463750.668776:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788463750.669726:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485907456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463750.669746:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff9618be00fe00/0x841acb7f42a3b350 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b357 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463750.669756:0:22623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff9618be00fe00/0x841acb7f42a3b350 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b357 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463750.669824:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485907584:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788463750.669871:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463750.669904:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff961883659a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788463750.670115:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485907584 00000100:00100000:2.0:1788463750.670122:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485907584 00000100:00100000:2.0:1788463750.670172:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788463750.670181:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e699450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+17:22623:x1875339485907584:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788463750.670197:0:22620:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788463750.670212:0:22620:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788463750.670216:0:22620:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1788463750.670315:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e699450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+17:22623:x1875339485907584:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463750.670323:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788463750.670391:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485907584:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788463750.670439:0:22623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788463750.670447:0:22623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618be00fe00/0x841acb7f42a3b350 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b357 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463750.670455:0:22623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff9618be00fe00/0x841acb7f42a3b350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b357 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463750.670465:0:22623:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788463750.670468:0:22623:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9618bf5d9000 from 12 10000000:01000000:0.0:1788463750.670471:0:22623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788463750.670495:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4400/0x841acb7f42a3b35e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463750.670503:0:22623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff96188f6f4400/0x841acb7f42a3b35e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463750.670510:0:22623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff96188f6f4400/0x841acb7f42a3b35e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463750.670524:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfe8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485907712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788463750.670552:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463750.670617:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618853f76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463750.671340:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485907712 00000100:00100000:2.0:1788463750.671348:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485907712 00000100:00100000:2.0:1788463750.671390:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788463750.671399:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e69b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+17:22623:x1875339485907712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463750.671410:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463750.671423:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961785e20200/0x841acb7f42a3b365 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b35e expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463750.671444:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961785e20200/0x841acb7f42a3b365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b35e expref: 18 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463750.671469:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961785e20200/0x841acb7f42a3b365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b35e expref: 18 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463750.671479:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20200, rc 0) 00000100:00100000:2.0:1788463750.671521:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e69b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:22623:x1875339485907712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463750.671528:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788463750.671565:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfe8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485907712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463750.671599:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff96188f6f4400/0x841acb7f42a3b35e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b365 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463750.671608:0:22623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff96188f6f4400/0x841acb7f42a3b35e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b365 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463750.671665:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad769500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485907840:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788463750.671696:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463750.671714:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff961884f86180 going to sleep for 11 seconds 00000100:00100000:2.0:1788463750.671727:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485907840 00000100:00100000:2.0:1788463750.671730:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485907840 00000100:00100000:2.0:1788463750.671747:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788463750.671753:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e698c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:22623:x1875339485907840:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788463750.671764:0:22621:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788463750.671777:0:22621:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788463750.671780:0:22621:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1788463750.671848:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e698c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:22623:x1875339485907840:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 94us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463750.671863:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788463750.671893:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad769500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485907840:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788463750.672054:0:22623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788463750.672062:0:22623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4400/0x841acb7f42a3b35e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b365 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463750.672070:0:22623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff96188f6f4400/0x841acb7f42a3b35e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b365 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463750.790747:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889fc9180 going to sleep for 0 seconds 00000040:00080000:1.0:1788463750.852565:0:23381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788463751.172446:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463751.816701:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889fc9180 going to sleep for 0 seconds 00010000:00010000:3.0:1788463752.199181:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463752.842868:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889fc9180 going to sleep for 0 seconds 00010000:00010000:3.0:1788463753.223769:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788463753.320113:0:23629:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg453-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788463753.860666:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889fc9180 going to sleep for 0 seconds 00000100:00080000:3.0:1788463754.115731:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788463754.115738:0:1365:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788463754.115742:0:1365:0:(import.c:65:import_set_state_nolock()) ffff9618850d2000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788463754.115754:0:1365:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9618850d2000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463754.115785:0:1365:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9618884f6300 x1875339485908096/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788463754.115806:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788463754.115810:0:1365:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788463754.115813:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788463754.115816:0:1365:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788463754.115843:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788463754.115847:0:1365:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788463754.115850:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788463754.115853:0:1365:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788463754.115887:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485908096:0@lo:38:kworker.0 00000100:00100000:3.0:1788463754.116006:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463754.116034:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485908096 00000100:00100000:2.0:1788463754.116045:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485908096 00000100:00100000:3.0:1788463754.116071:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485908224:0@lo:400:kworker.0 00000100:00100000:3.0:1788463754.116110:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463754.116116:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788463754.116125:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875339485908096:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788463754.116129:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463754.116136:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485908352:0@lo:400:kworker.0 00010000:00080000:2.0:1788463754.116155:0:22631:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 793 last 0 00000100:00100000:3.0:1788463754.116176:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788463754.116193:0:22631:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x841acb7f42a3b36c 00000004:00100000:2.0:1788463754.116211:0:22631:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788463754.116218:0:22631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:2.0:1788463754.116306:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485908352 00000100:00100000:2.0:1788463754.116310:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485908352 00000100:00100000:2.0:1788463754.116349:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788463754.116357:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485908352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463754.116421:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485908352:12345-0@lo:400:kworker.0 Request processed in 65us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463754.116429:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788463754.116460:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485908352:0@lo:400:kworker.0 00000100:00100000:1.0:1788463754.116674:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485908480:0@lo:400:kworker.0 00000100:00100000:1.0:1788463754.116710:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463754.116730:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463754.116736:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:abd83a7b-f7e3-4d68-aade-6298a66ab956:3650:1875339485907968:0@lo:400:kworker.0 00000100:00100000:1.0:1788463754.116768:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463754.116804:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463754.116810:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485908608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463754.116843:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463754.116888:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485907968 00000100:00100000:3.0:1788463754.116893:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485907968 00000100:00100000:3.0:1788463754.116934:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788463754.116942:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e69a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:3650:x1875339485907968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463754.116978:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e69a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:3650:x1875339485907968:12345-0@lo:400:kworker.0 Request processed in 38us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463754.116992:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788463754.117092:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:abd83a7b-f7e3-4d68-aade-6298a66ab956:3650:1875339485907968:0@lo:400:kworker.0 00000100:00100000:0.0:1788463754.117264:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485908224 00000100:00100000:0.0:1788463754.117269:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485908224 00000100:00100000:0.0:1788463754.117353:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485908480 00000100:00100000:0.0:1788463754.117357:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485908480 00000100:00100000:3.0:1788463754.117883:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788463754.117892:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485908224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463754.117953:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485908224:12345-0@lo:400:kworker.0 Request processed in 62us (1842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463754.117960:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788463754.117977:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788463754.117986:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485908480:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788463754.118010:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9618884f5180 x1875339485908224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463754.118024:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485908480:12345-0@lo:400:kworker.0 Request processed in 39us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463754.118025:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485908224:0@lo:400:kworker.0 00000100:00100000:3.0:1788463754.118037:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788463754.118079:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9618884f5500 x1875339485908480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463754.118089:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485908480:0@lo:400:kworker.0 00000100:00100000:2.0:1788463754.119127:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485908608 00000100:00100000:2.0:1788463754.119146:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485908608 00000100:00100000:2.0:1788463754.119180:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788463754.119189:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485908608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788463754.119221:0:22632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788463754.119285:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485908608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (2439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463754.119292:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788463754.122769:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485908608:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1788463754.124329:0:22631:0:(import.c:65:import_set_state_nolock()) ffff9618ae9d2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788463754.125745:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875339485908096:12345-0@lo:38:kworker.0 Request processed in 9613us (9733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463754.125758:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788463754.127912:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788463754.127928:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788463754.127936:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788463754.127942:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9618850d2000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788463754.127972:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000bb1906db): req@ffff96188cfeaa00 x1875339485900672/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463754.128137:0:22668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463754.128156:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463754.128174:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485908736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463754.128188:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889fc9180 going to sleep for 11 seconds 00000100:00100000:2.0:1788463754.128189:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485908096:0@lo:38:kworker.0 00000100:00100000:3.0:1788463754.128209:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463754.128212:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485900672 00000100:00100000:1.0:1788463754.128219:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485900672 00000100:00100000:2.0:1788463754.128235:0:23368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485908736 00000100:00100000:2.0:1788463754.128239:0:23368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485908736 00000100:00100000:1.0:1788463754.128266:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788463754.128275:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22668:x1875339485900672:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788463754.128277:0:23368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788463754.128283:0:23368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3649:x1875339485908736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788463754.128324:0:23368:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788463754.128415:0:23368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3649:x1875339485908736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463754.128421:0:23368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788463754.128484:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22668:x1875339485900672:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 210us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463754.128491:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788463754.128743:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485908736:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788463754.128956:0:22668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfeaa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22668:1875339485900672:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788463754.129009:0:22668:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788463754.129048:0:22668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad769500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22668:1875339485908864:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788463754.129104:0:22668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463754.129127:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff961884f86840 going to sleep for 11 seconds 00000100:00100000:3.0:1788463754.130089:0:23368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485908864 00000100:00100000:3.0:1788463754.130099:0:23368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485908864 00000100:00100000:3.0:1788463754.130148:0:23368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788463754.130158:0:23368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22668:x1875339485908864:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788463754.130306:0:23368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22668:x1875339485908864:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 150us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463754.130315:0:23368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788463754.130400:0:22668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad769500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22668:1875339485908864:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788463754.130485:0:22668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfe9880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22668:1875339485908992:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788463754.130518:0:22668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463754.130541:0:22668:0:(client.c:2716:ptlrpc_set_wait()) set ffff961884f21f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788463754.130555:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485908992 00000100:00100000:0.0:1788463754.130559:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485908992 00000100:00100000:0.0:1788463754.130794:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788463754.130802:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cfe8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22668:x1875339485908992:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788463754.130858:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cfe8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22668:x1875339485908992:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 57us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463754.130865:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788463754.131000:0:22668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfe9880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22668:1875339485908992:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1788463754.131044:0:22668:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788463754.134919:0:22668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788463754.134997:0:22668:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 22, retries 0 00000004:00080000:0.0:1788463754.135002:0:22668:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:1.0:1788463754.243481:0:23681:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00010000:00010000:3.0:1788463754.251063:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788463754.251482:0:23681:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1788463754.821023:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1788463755.125838:0:23731:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788463755.126082:0:23731:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788463755.267808:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463756.291859:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788463756.381132:0:23779:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa34cbab0 20000000:00000080:2.0:1788463756.381151:0:23779:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9618c13d2400 uarg=0000000000000000 20000000:01000000:2.0:1788463756.381192:0:23779:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788463756.381199:0:23779:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788463756.381203:0:23779:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788463756.382056:0:23780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788463756.382218:0:23779:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788463756.389086:0:23779:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788463756.389206:0:23779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff961882813a00/0x841acb7f42a3b373 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463756.389229:0:23779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9618be00ea00/0x841acb7f42a3b21c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b215 expref: 17 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463756.389237:0:23779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961786bdec00/0x841acb7f42a3b31f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b318 expref: 17 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463756.389245:0:23779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff961882813a00/0x841acb7f42a3b373 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463756.389292:0:23779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961786bdec00/0x841acb7f42a3b31f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3b318 expref: 17 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463756.389321:0:23779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff961786bdec00/0x841acb7f42a3b31f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3b318 expref: 17 pid: 22621 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463756.389335:0:23779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23779:1875339485909120:0@lo:104: 00000100:00100000:3.0:1788463756.389405:0:23779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788463756.389466:0:23779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9618be00ea00/0x841acb7f42a3b21c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3b215 expref: 17 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463756.389475:0:23779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9618be00ea00/0x841acb7f42a3b21c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3b215 expref: 17 pid: 22618 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463756.389484:0:23779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23779:1875339485909248:0@lo:104: 00000100:00100000:3.0:1788463756.389505:0:23779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463756.389527:0:23779:0:(client.c:2716:ptlrpc_set_wait()) set ffff961883659780 going to sleep for 11 seconds 00000100:00100000:1.0:1788463756.389685:0:22609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485909120 00000100:00100000:1.0:1788463756.389693:0:22609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485909120 00000100:00100000:1.0:1788463756.389730:0:22609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485909248 00000100:00100000:1.0:1788463756.389733:0:22609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485909248 00000100:00100000:1.0:1788463756.389744:0:22609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788463756.389752:0:22609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:abd83a7b-f7e3-4d68-aade-6298a66ab956+4:23779:x1875339485909120:12345-0@lo:104: 00010000:00010000:1.0:1788463756.389769:0:22609:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a3b318 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3b31f expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463756.389824:0:22609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788463756.389830:0:22609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:abd83a7b-f7e3-4d68-aade-6298a66ab956+4:23779:x1875339485909120:12345-0@lo:104: Request processed in 79us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463756.389836:0:22609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788463756.389853:0:22609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788463756.389859:0:22609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:abd83a7b-f7e3-4d68-aade-6298a66ab956+3:23779:x1875339485909248:12345-0@lo:104: 00010000:00010000:1.0:1788463756.389867:0:22609:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b215 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3b21c expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463756.389898:0:22609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788463756.389903:0:22609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:abd83a7b-f7e3-4d68-aade-6298a66ab956+3:23779:x1875339485909248:12345-0@lo:104: Request processed in 45us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463756.389908:0:22609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788463756.389923:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788463756.389929:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a3b318 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3b31f expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463756.389935:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4e00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:1.0:1788463756.389939:0:22614:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a3b318 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3b31f expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463756.389948:0:22614:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a3b318 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3b31f expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463756.389955:0:22614:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a3b318 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3b31f expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463756.389967:0:22614:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788463756.389997:0:22614:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a3b318 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b31f expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463756.390003:0:22614:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463756.390036:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a3b318 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b31f expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463756.390044:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a3b318 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b31f expref: -99 pid: 23359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463756.390058:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463756.390061:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b215 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3b21c expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463756.390067:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf400 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:1.0:1788463756.390070:0:22614:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b215 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3b21c expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463756.390077:0:22614:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b215 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3b21c expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463756.390083:0:22614:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b215 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3b21c expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463756.390088:0:22614:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788463756.390101:0:22614:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b215 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b21c expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463756.390107:0:22614:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463756.390129:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b215 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b21c expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463756.390136:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b215 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b21c expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463756.390149:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463756.390151:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463756.390153:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463756.390159:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463756.390177:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:abd83a7b-f7e3-4d68-aade-6298a66ab956:3649:1875339485909376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463756.390207:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463756.390239:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:abd83a7b-f7e3-4d68-aade-6298a66ab956:3650:1875339485909504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463756.390258:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463756.390303:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485909376 00000100:00100000:1.0:1788463756.390320:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485909376 00010000:00010000:1.0:1788463756.390338:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961786bdec00/0x841acb7f42a3b31f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3b318 expref: 18 pid: 22621 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463756.390358:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485909504 00000100:00100000:1.0:1788463756.390361:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485909504 00010000:00010000:1.0:1788463756.390371:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9618be00ea00/0x841acb7f42a3b21c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3b215 expref: 19 pid: 22618 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463756.390384:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788463756.390390:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:abd83a7b-f7e3-4d68-aade-6298a66ab956+19:3649:x1875339485909376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788463756.390400:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463756.390405:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961786bdec00/0x841acb7f42a3b31f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3b318 expref: 19 pid: 22621 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463756.390425:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961786bdec00/0x841acb7f42a3b31f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3b318 expref: 19 pid: 22621 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463756.390439:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463756.390465:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:abd83a7b-f7e3-4d68-aade-6298a66ab956+19:3649:x1875339485909376:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463756.390472:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788463756.390483:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788463756.390489:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:3650:x1875339485909504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788463756.390496:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463756.390500:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9618be00ea00/0x841acb7f42a3b21c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3b215 expref: 18 pid: 22618 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463756.390509:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9618be00ea00/0x841acb7f42a3b21c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3b215 expref: 18 pid: 22618 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463756.390520:0:22612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff961882813a00/0x841acb7f42a3b373 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463756.390529:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961882813a00/0x841acb7f42a3b373 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463756.390541:0:22612:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961882813a00/0x841acb7f42a3b373 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463756.390547:0:22612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961882813a00/0x841acb7f42a3b373 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463756.390554:0:22612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff961882813a00/0x841acb7f42a3b373 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463756.390566:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff961882813a00/0x841acb7f42a3b373 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463756.390571:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813a00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463756.390596:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff961882813a00/0x841acb7f42a3b373 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463756.390604:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff961882813a00/0x841acb7f42a3b373 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463756.390612:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff961882813a00/0x841acb7f42a3b373 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463756.390622:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463756.390648:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:3650:x1875339485909504:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463756.390655:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788463756.390691:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:abd83a7b-f7e3-4d68-aade-6298a66ab956:3650:1875339485909504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463756.390715:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:abd83a7b-f7e3-4d68-aade-6298a66ab956:3649:1875339485909376:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463756.391148:0:23779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961786bdec00/0x841acb7f42a3b31f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3b318 expref: 17 pid: 22621 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463756.391161:0:23779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23779:1875339485909120:0@lo:104: 00010000:00010000:3.0:1788463756.391172:0:23779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618be00ea00/0x841acb7f42a3b21c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3b215 expref: 16 pid: 22618 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463756.391181:0:23779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23779:1875339485909248:0@lo:104: 00010000:00010000:3.0:1788463756.391196:0:23779:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff961882813a00/0x841acb7f42a3b373 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463756.391205:0:23779:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff961882813a00/0x841acb7f42a3b373 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463756.391211:0:23779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff961882813a00/0x841acb7f42a3b373 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463756.391217:0:23779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961882813a00/0x841acb7f42a3b373 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463757.188050:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463742/real 1788463742] req@ffff9618ad769180 x1875339485901696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463757 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463757.188120:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9618ad769180 x1875339485901696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463757 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463757.188144:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463742/real 1788463742] req@ffff9618ad76b100 x1875339485901824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463757 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463757.188157:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9618ad76b100 x1875339485901824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463757 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788463757.188186:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188ced8000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788463757.188208:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788463757.188213:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485901696:0@lo:8:kworker.0 00000100:00080000:2.0:1788463757.188219:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9617873e8000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788463757.188225:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788463757.188228:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485901824:0@lo:8:kworker.0 00000100:00080000:1.0:1788463757.188463:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788463757.188468:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788463757.188470:0:36:0:(import.c:65:import_set_state_nolock()) ffff96188ced8000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788463757.188475:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 781 00000100:00080000:1.0:1788463757.188481:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788463757.188488:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96188ced8000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:1.0:1788463757.188508:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188d1d2680 x1875339485909888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788463757.188529:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788463757.188532:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788463757.188534:0:36:0:(import.c:65:import_set_state_nolock()) ffff9617873e8000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788463757.188537:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 781 00000100:00080000:1.0:1788463757.188540:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788463757.188543:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9617873e8000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:1.0:1788463757.188555:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188d1d0a80 x1875339485910016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788463757.188604:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788463757.188607:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788463757.188610:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788463757.188612:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788463757.188638:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485909760:0@lo:400:kworker.0 00000100:00100000:1.0:1788463757.188715:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463757.188745:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463757.188751:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485910144:0@lo:400:kworker.0 00000100:00100000:1.0:1788463757.188778:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463757.188873:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:abd83a7b-f7e3-4d68-aade-6298a66ab956:3651:1875339485909632:0@lo:400:kworker.0 00000100:00100000:0.0:1788463757.188907:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463757.188943:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485910400:0@lo:400:kworker.0 00000100:00100000:0.0:1788463757.188967:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463757.188987:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788463757.188992:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485910272:0@lo:400:kworker.0 00000100:00100000:0.0:1788463757.189031:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463757.189061:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485909760 00000100:00100000:0.0:1788463757.189069:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485909760 00000100:00100000:0.0:1788463757.189110:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485910272 00000100:00100000:0.0:1788463757.189114:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485910272 00000100:00100000:0.0:1788463757.189131:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788463757.189139:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875339485909760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463757.189205:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875339485909760:12345-0@lo:400:kworker.0 Request processed in 66us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463757.189213:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788463757.189229:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788463757.189235:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cfea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485910272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463757.189267:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cfea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485910272:12345-0@lo:400:kworker.0 Request processed in 32us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463757.189273:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788463757.189291:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485910144 00000100:00100000:0.0:1788463757.189294:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485910144 00000100:00100000:0.0:1788463757.189316:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485910400 00000100:00100000:0.0:1788463757.189318:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485910400 00000100:00100000:0.0:1788463757.189331:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788463757.189336:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485910144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463757.189374:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485910144:12345-0@lo:400:kworker.0 Request processed in 38us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463757.189381:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788463757.189392:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788463757.189398:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cfe9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485910400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463757.189423:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cfe9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485910400:12345-0@lo:400:kworker.0 Request processed in 25us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463757.189428:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788463757.189469:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96188d1d1c00 x1875339485910144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463757.189481:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485910144:0@lo:400:kworker.0 00000100:00100000:0.0:1788463757.189491:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485909760:0@lo:400:kworker.0 00000100:00100000:0.0:1788463757.189515:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485910272:0@lo:400:kworker.0 00010000:00080000:0.0:1788463757.189524:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96188d1d0380 x1875339485910400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463757.189532:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485910400:0@lo:400:kworker.0 00000100:00100000:1.0:1788463757.190450:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485909632 00000100:00100000:1.0:1788463757.190459:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485909632 00000100:00100000:1.0:1788463757.190500:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788463757.190509:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e69b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+16:3651:x1875339485909632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463757.190557:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e69b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+16:3651:x1875339485909632:12345-0@lo:400:kworker.0 Request processed in 51us (1649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463757.190599:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788463757.190729:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:abd83a7b-f7e3-4d68-aade-6298a66ab956:3651:1875339485909632:0@lo:400:kworker.0 00000100:00100000:2.0:1788463757.190826:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485909888:0@lo:8:kworker.0 00000400:00000100:2.0:1788463757.190860:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875339485909888 offset 0 length 520: 4 00000100:00100000:2.0:1788463757.190890:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485910016:0@lo:8:kworker.0 00000400:00000100:2.0:1788463757.190908:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875339485910016 offset 0 length 520: 4 00010000:00010000:3.0:1788463757.317242:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788463757.958607:0:22623:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788463757.958616:0:22623:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff961787d22000 from 13 10000000:01000000:2.0:1788463757.958623:0:22623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788463757.958677:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a3b37a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463757.958689:0:22623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a3b37a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463757.958701:0:22623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a3b37a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463757.958741:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485910528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788463757.958822:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463757.958871:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff961884f86480 going to sleep for 11 seconds 00000100:00100000:1.0:1788463757.958934:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485910528 00000100:00100000:1.0:1788463757.958943:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485910528 00000100:00100000:1.0:1788463757.959011:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788463757.959022:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e69a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+16:22623:x1875339485910528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463757.959036:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463757.959051:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961786bdfc00/0x841acb7f42a3b381 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b37a expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463757.959075:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961786bdfc00/0x841acb7f42a3b381 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b37a expref: 17 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463757.959086:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961786bdfc00/0x841acb7f42a3b381 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b37a expref: 17 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463757.959096:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdfc00, rc 0) 00000100:00100000:1.0:1788463757.959144:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e69a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+17:22623:x1875339485910528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463757.959150:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788463757.959241:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485910528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463757.959256:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a3b37a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b381 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463757.959266:0:22623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a3b37a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b381 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463757.959332:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485910656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463757.959391:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463757.959411:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff961884f86480 going to sleep for 11 seconds 00000100:00100000:0.0:1788463757.959545:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485910656 00000100:00100000:0.0:1788463757.959550:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485910656 00000100:00100000:0.0:1788463757.959608:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788463757.959616:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e699c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+17:22623:x1875339485910656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463757.959740:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e699c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+17:22623:x1875339485910656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463757.959756:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788463757.960631:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485910656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463757.960676:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485910784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463757.960726:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463757.960765:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff961884f86480 going to sleep for 11 seconds 00000100:00100000:1.0:1788463757.962021:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485910784 00000100:00100000:1.0:1788463757.962033:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485910784 00000100:00100000:1.0:1788463757.962090:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788463757.962101:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+17:22623:x1875339485910784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788463757.962236:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+17:22623:x1875339485910784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (1509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463757.962244:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788463757.962357:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485910784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788463757.971244:0:23840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788463757.971602:0:22623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788463757.971625:0:22623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788463757.971637:0:22623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a3b37a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b381 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463757.971649:0:22623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a3b37a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b381 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463757.971660:0:22623:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788463757.971663:0:22623:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9618bf5d9000 from 13 10000000:01000000:2.0:1788463757.971666:0:22623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788463757.971707:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b388 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463757.971715:0:22623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b388 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463757.971727:0:22623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b388 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463757.971754:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485910912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788463757.971836:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463757.971877:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff961884f86480 going to sleep for 11 seconds 00000100:00100000:0.0:1788463757.972895:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485910912 00000100:00100000:0.0:1788463757.972906:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485910912 00000100:00100000:0.0:1788463757.972953:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788463757.972961:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e698050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+17:22623:x1875339485910912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463757.972976:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463757.973003:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96188f6f5a00/0x841acb7f42a3b38f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b388 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463757.973030:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96188f6f5a00/0x841acb7f42a3b38f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b388 expref: 18 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463757.973041:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96188f6f5a00/0x841acb7f42a3b38f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b388 expref: 18 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463757.973054:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f5a00, rc 0) 00000100:00100000:0.0:1788463757.973121:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e698050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:22623:x1875339485910912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463757.973128:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788463757.973155:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485910912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463757.973176:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b388 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b38f expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463757.973186:0:22623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b388 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b38f expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463757.973319:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485911040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463757.973351:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463757.973554:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff961884f86480 going to sleep for 11 seconds 00000100:00100000:1.0:1788463757.973947:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485911040 00000100:00100000:1.0:1788463757.973955:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485911040 00000100:00100000:1.0:1788463757.974008:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788463757.974019:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e69a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:22623:x1875339485911040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463757.974192:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e69a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:22623:x1875339485911040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463757.974200:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788463757.977236:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485911040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463757.977305:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485911168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463757.977523:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463757.977559:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff961884f86480 going to sleep for 11 seconds 00000100:00100000:0.0:1788463757.977622:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485911168 00000100:00100000:0.0:1788463757.977630:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485911168 00000100:00100000:0.0:1788463757.977685:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788463757.977695:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:22623:x1875339485911168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788463757.977825:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:22623:x1875339485911168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463757.977833:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788463757.977892:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485911168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788463757.980644:0:23841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788463757.980882:0:22623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788463757.980906:0:22623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788463757.980919:0:22623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b388 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b38f expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463757.980932:0:22623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b388 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b38f expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463758.211757:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463748/real 1788463748] req@ffff96188d1d0700 x1875339485904384/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463758 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463758.211787:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96188d1d0700 x1875339485904384/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463758 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463758.211848:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463748/real 1788463748] req@ffff96188cfe8a80 x1875339485904256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463758 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463758.211860:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96188cfe8a80 x1875339485904256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463758 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788463758.211897:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961882e02800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788463758.211924:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788463758.211929:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485904384:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788463758.211934:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188d0ed800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788463758.211939:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788463758.211942:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfe8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485904256:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788463758.212075:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788463758.212081:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788463758.212083:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788463758.212086:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788463758.212128:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788463758.212132:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788463758.212135:0:36:0:(import.c:65:import_set_state_nolock()) ffff96188d0ed800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788463758.212140:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 788 00000100:00080000:1.0:1788463758.212145:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788463758.212152:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff96188d0ed800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:1.0:1788463758.212175:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188fc20a80 x1875339485911680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788463758.212187:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788463758.212190:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788463758.212191:0:36:0:(import.c:65:import_set_state_nolock()) ffff961882e02800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788463758.212195:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 788 00000100:00080000:1.0:1788463758.212204:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788463758.212208:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff961882e02800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:1.0:1788463758.212222:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188fc21180 x1875339485911808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788463758.212256:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485911936:0@lo:400:kworker.0 00000100:00100000:1.0:1788463758.212330:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463758.212361:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788463758.212367:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485911552:0@lo:400:kworker.0 00000100:00100000:1.0:1788463758.212393:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463758.212422:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485911936 00000100:00100000:1.0:1788463758.212430:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485911936 00000100:00100000:1.0:1788463758.212491:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788463758.212501:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485911936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463758.212553:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485911936:12345-0@lo:400:kworker.0 Request processed in 53us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463758.212560:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788463758.212610:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485911552 00000100:00100000:1.0:1788463758.212614:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485911552 00000100:00100000:1.0:1788463758.212637:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788463758.212644:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485911552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463758.212676:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485911552:12345-0@lo:400:kworker.0 Request processed in 33us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463758.212683:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788463758.212741:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485911552:0@lo:400:kworker.0 00010000:00080000:1.0:1788463758.212750:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96188fc20e00 x1875339485911936/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463758.212771:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485911936:0@lo:400:kworker.0 00000100:00100000:0.0:1788463758.212857:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485911296:0@lo:400:kworker.0 00000100:00100000:0.0:1788463758.212892:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463758.212916:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788463758.212922:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485911424:0@lo:400:kworker.0 00000100:00100000:0.0:1788463758.212941:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463758.213014:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485911296 00000100:00100000:1.0:1788463758.213019:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485911296 00000100:00100000:1.0:1788463758.213084:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788463758.213091:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cfea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875339485911296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463758.213143:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cfea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875339485911296:12345-0@lo:400:kworker.0 Request processed in 51us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463758.213149:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788463758.213211:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485911424 00000100:00100000:2.0:1788463758.213216:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485911424 00000100:00100000:2.0:1788463758.213244:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788463758.213250:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cfe9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485911424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463758.213282:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cfe9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485911424:12345-0@lo:400:kworker.0 Request processed in 32us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463758.213288:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788463758.213310:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485911680:0@lo:8:kworker.0 00000400:00000100:2.0:1788463758.213331:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875339485911680 offset 0 length 520: 4 00000100:00100000:2.0:1788463758.213353:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485911808:0@lo:8:kworker.0 00000400:00000100:2.0:1788463758.213366:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875339485911808 offset 0 length 520: 4 00010000:00080000:0.0:1788463758.225951:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96188fc20000 x1875339485911424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463758.225970:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485911424:0@lo:400:kworker.0 00000100:00100000:0.0:1788463758.226003:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485911296:0@lo:400:kworker.0 00010000:00010000:3.0:1788463758.339857:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463759.235971:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485912064:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788463759.236116:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463759.236178:0:23368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485912064 00000100:00100000:3.0:1788463759.236187:0:23368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485912064 00000100:00100000:3.0:1788463759.236239:0:23368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788463759.236260:0:23368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875339485912064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788463759.236301:0:23368:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788463759.236541:0:23368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875339485912064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 292us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463759.236550:0:23368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788463759.236628:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485912064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463759.237430:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485912192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463759.237516:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463759.237553:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485912192 00000100:00100000:1.0:1788463759.237559:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485912192 00000100:00100000:1.0:1788463759.237612:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788463759.237620:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485912192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788463759.237647:0:22632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788463759.237690:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485912192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463759.237696:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788463759.237735:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485912192:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788463759.364738:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788463759.755861:0:23360:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:2.0:1788463760.071244:0:23381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788463760.387786:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463761.411899:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463762.435874:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463763.335409:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:abd83a7b-f7e3-4d68-aade-6298a66ab956:3650:1875339485912320:0@lo:400:kworker.0 00000100:00100000:2.0:1788463763.335487:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463763.335673:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485912320 00000100:00100000:0.0:1788463763.335682:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485912320 00000100:00100000:0.0:1788463763.335733:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788463763.335742:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f943850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:3650:x1875339485912320:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788463763.338658:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788463763.338668:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788463763.338671:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788463763.338674:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788463763.338735:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788463763.338751:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788463763.338755:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788463763.338759:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788463763.338802:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485912448:0@lo:400:kworker.0 00000100:00100000:3.0:1788463763.338872:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463763.338921:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788463763.338938:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485912832:0@lo:400:kworker.0 00000100:00100000:3.0:1788463763.338967:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463763.338995:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485912576:0@lo:400:kworker.0 00000100:00100000:3.0:1788463763.339018:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463763.339040:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463763.339045:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485912704:0@lo:400:kworker.0 00000100:00100000:3.0:1788463763.339066:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463763.339098:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485912448 00000100:00100000:3.0:1788463763.339104:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485912448 00000100:00100000:3.0:1788463763.339146:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485912704 00000100:00100000:3.0:1788463763.339150:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485912704 00000100:00100000:3.0:1788463763.339164:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788463763.339173:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485912448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463763.339224:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485912448:12345-0@lo:400:kworker.0 Request processed in 52us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463763.339232:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788463763.339250:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788463763.339257:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485912704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463763.339289:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485912704:12345-0@lo:400:kworker.0 Request processed in 33us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463763.339296:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788463763.339315:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485912832 00000100:00100000:3.0:1788463763.339318:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485912832 00000100:00100000:3.0:1788463763.339342:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485912576 00000100:00100000:3.0:1788463763.339345:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485912576 00000100:00100000:3.0:1788463763.339356:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788463763.339362:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485912832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463763.339401:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485912832:12345-0@lo:400:kworker.0 Request processed in 38us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463763.339408:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788463763.339420:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788463763.339426:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485912576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463763.339450:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485912576:12345-0@lo:400:kworker.0 Request processed in 25us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463763.339455:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788463763.339501:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485912704:0@lo:400:kworker.0 00010000:00080000:3.0:1788463763.339514:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96188d1c0000 x1875339485912576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463763.339522:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485912576:0@lo:400:kworker.0 00010000:00080000:3.0:1788463763.339564:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96188d1c2680 x1875339485912832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463763.339592:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485912832:0@lo:400:kworker.0 00000100:00100000:3.0:1788463763.339604:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485912448:0@lo:400:kworker.0 00000100:00100000:0.0:1788463763.342509:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f943850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:3650:x1875339485912320:12345-0@lo:400:kworker.0 Request processed in 6759us (7013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463763.342525:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788463763.342980:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:abd83a7b-f7e3-4d68-aade-6298a66ab956:3650:1875339485912320:0@lo:400:kworker.0 00010000:00010000:2.0:1788463763.470406:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788463764.010401:0:24127:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788463764.010405:0:24127:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788463764.010407:0:24127:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788463764.010732:0:24127:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9618c16bd800 00000020:01000004:2.0:1788463764.010747:0:24127:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788463764.010761:0:24127:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788463764.010774:0:24127:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff96188d3a19c0) 00000020:00000080:2.0:1788463764.010802:0:24127:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00000040:00080000:3.0:1788463764.043344:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00100000:10000000:2.0:1788463764.090164:0:24127:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788463764.093393:0:24127:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788463764.093657:0:24127:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788463764.094456:0:24127:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788463764.094786:0:24127:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788463764.097118:0:24127:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788463764.098619:0:24127:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:2.0:1788463764.100721:0:24127:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788463764.101139:0:24127:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788463764.101154:0:24127:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788463764.101233:0:24127:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x841acb7f42a3b39d 00000020:01000004:2.0:1788463764.101240:0:24127:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788463764.101263:0:24127:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.153@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788463764.101267:0:24127:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788463764.101273:0:24127:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788463764.101278:0:24127:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788463764.101305:0:24127:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff96188d803380) 00000020:00000080:2.0:1788463764.101320:0:24127:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788463764.104995:0:24127:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788463764.105189:0:24127:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788463764.105195:0:24127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788463764.107058:0:24127:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788463764.107071:0:24127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788463764.107928:0:24127:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788463764.107937:0:24127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788463764.111432:0:24127:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788463764.111716:0:24127:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788463764.111722:0:24127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788463764.112662:0:24127:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788463764.112671:0:24127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788463764.149750:0:24127:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788463764.150013:0:24127:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788463764.150020:0:24127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788463764.161662:0:24127:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788463764.161683:0:24127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788463764.167264:0:24127:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788463764.167281:0:24127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788463764.174793:0:24127:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788463764.175209:0:24127:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788463764.175216:0:24127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788463764.184355:0:24127:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788463764.184371:0:24127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788463764.244020:0:24127:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788463764.244308:0:24127:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788463764.244315:0:24127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788463764.246340:0:24127:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788463764.246356:0:24127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788463764.246884:0:24127:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788463764.246913:0:24127:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788463764.246920:0:24127:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.153@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788463764.270897:0:24127:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.153@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788463764.270936:0:24127:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.153@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788463764.270940:0:24127:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788463764.270942:0:24127:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788463764.270944:0:24127:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788463764.270945:0:24127:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788463764.270946:0:24127:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788463764.270947:0:24127:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788463764.270949:0:24127:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788463764.270950:0:24127:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788463764.270951:0:24127:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788463764.270955:0:24127:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788463764.270957:0:24127:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788463764.270958:0:24127:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788463764.270964:0:24127:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788463764.270965:0:24127:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788463764.270966:0:24127:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788463764.270967:0:24127:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788463764.270967:0:24127:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788463764.270968:0:24127:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788463764.270969:0:24127:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788463764.270995:0:24127:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788463764.271014:0:24127:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfe9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485912960:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788463764.271090:0:24127:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463764.271180:0:24127:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b3265900 going to sleep for 11 seconds 00000100:00100000:3.0:1788463764.271441:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485912960 00000100:00100000:3.0:1788463764.271450:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485912960 00000100:00100000:3.0:1788463764.271556:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788463764.271566:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f943450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:24127:x1875339485912960:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788463764.271631:0:22621:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788463764.271634:0:22621:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788463764.271638:0:22621:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788463764.272023:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f943450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:24127:x1875339485912960:12345-0@lo:253:mount.lustre.0 Request processed in 457us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463764.272032:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788463764.272123:0:24127:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfe9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485912960:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788463764.272134:0:24127:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788463764.272136:0:24127:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788463764.272138:0:24127:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788463764.272140:0:24127:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463764.272141:0:24127:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463764.272142:0:24127:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463764.272143:0:24127:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463764.272159:0:24127:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788463764.272161:0:24127:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463764.272162:0:24127:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788463764.272205:0:24127:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9618c16bd800 from lustre-OST0000 10000000:01000000:2.0:1788463764.272236:0:24127:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788463764.272239:0:24127:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788463764.272246:0:24127:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9617887899c0 local copy 00010000:00010000:2.0:1788463764.272256:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5e00/0x841acb7f42a3b158 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b15f expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463764.272364:0:24127:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485913088:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463764.272395:0:24127:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463764.274679:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485913088 00000100:00100000:1.0:1788463764.274694:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485913088 00000100:00100000:1.0:1788463764.274747:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788463764.274757:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:24127:x1875339485913088:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463764.274881:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:24127:x1875339485913088:12345-0@lo:501:mount.lustre.0 Request processed in 125us (2484us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788463764.274903:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788463764.275340:0:24127:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618853f7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788463764.275368:0:24127:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485913088:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788463764.275390:0:24127:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788463764.275423:0:24127:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788463764.275432:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5e00/0x841acb7f42a3b158 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b15f expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463764.275444:0:24127:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff96188f6f5e00/0x841acb7f42a3b158 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b15f expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463764.275480:0:24127:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9618c16bd800 10000000:01000000:0.0:1788463764.275485:0:24127:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788463764.275491:0:24127:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788463764.275494:0:24127:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788463764.275500:0:24127:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788463764.275503:0:24127:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788463764.275536:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4000/0x841acb7f42a3b3ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463764.275544:0:24127:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff96188f6f4000/0x841acb7f42a3b3ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463764.275562:0:24127:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff96188f6f4000/0x841acb7f42a3b3ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463764.275656:0:24127:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfe9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485913216:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788463764.275697:0:24127:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463764.275762:0:24127:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b3265240 going to sleep for 11 seconds 00000100:00100000:1.0:1788463764.275796:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485913216 00000100:00100000:1.0:1788463764.275801:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485913216 00000100:00100000:1.0:1788463764.275841:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788463764.275848:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+18:24127:x1875339485913216:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788463764.275859:0:22620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463764.275884:0:22620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961786bdf200/0x841acb7f42a3b3b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b3ab expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.275909:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961786bdf200/0x841acb7f42a3b3b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b3ab expref: 19 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.276040:0:22620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961786bdf200/0x841acb7f42a3b3b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b3ab expref: 19 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.276049:0:22620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdf200, rc 0) 00000100:00100000:1.0:1788463764.276133:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+19:24127:x1875339485913216:12345-0@lo:101:mount.lustre.0 Request processed in 284us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463764.276140:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788463764.276350:0:24127:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfe9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485913216:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788463764.276364:0:24127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff96188f6f4000/0x841acb7f42a3b3ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b3b2 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463764.276374:0:24127:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff96188f6f4000/0x841acb7f42a3b3ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b3b2 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788463764.279500:0:24127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:0.0:1788463764.280423:0:24127:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788463764.283501:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788463764.283558:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1788463764.283695:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1788463764.283715:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1788463764.283730:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1788463764.283741:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1788463764.283753:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1788463764.283764:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1788463764.283778:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:0.0:1788463764.283810:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:0.0:1788463764.283825:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:0.0:1788463764.283839:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:0.0:1788463764.283876:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:0.0:1788463764.283882:0:24127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:0.0:1788463764.283999:0:24127:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfe9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485913344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463764.284067:0:24127:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463764.284502:0:24127:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b3265e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788463764.284553:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485913344 00000100:00100000:1.0:1788463764.284561:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485913344 00000100:00100000:1.0:1788463764.284848:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788463764.284859:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+19:24127:x1875339485913344:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463764.285035:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+19:24127:x1875339485913344:12345-0@lo:501:mount.lustre.0 Request processed in 177us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463764.285042:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788463764.285119:0:24127:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfe9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485913344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463764.285172:0:24127:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfe9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485913472:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788463764.285218:0:24127:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463764.285352:0:24127:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b3265e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788463764.285414:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485913472 00000100:00100000:3.0:1788463764.285419:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485913472 00000100:00100000:3.0:1788463764.285444:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788463764.285451:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+19:24127:x1875339485913472:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788463764.286609:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+19:24127:x1875339485913472:12345-0@lo:503:mount.lustre.0 Request processed in 1151us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463764.286620:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788463764.286830:0:24127:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfe9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485913472:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788463764.287459:0:24127:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788463764.287549:0:24127:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485913600:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788463764.287804:0:24127:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463764.287843:0:24127:0:(client.c:2716:ptlrpc_set_wait()) set ffff961884f21000 going to sleep for 11 seconds 00000100:00100000:0.0:1788463764.287896:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485913600 00000100:00100000:0.0:1788463764.287903:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485913600 00000100:00100000:0.0:1788463764.287947:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788463764.287957:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+19:24127:x1875339485913600:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788463764.288438:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+19:24127:x1875339485913600:12345-0@lo:502:mount.lustre.0 Request processed in 481us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463764.288447:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788463764.288611:0:24127:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485913600:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788463764.288837:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788463764.288880:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788463764.288898:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788463764.288912:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788463764.288924:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788463764.288937:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788463764.288950:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788463764.288965:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788463764.288981:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1788463764.289010:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1788463764.289025:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1788463764.289040:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1788463764.289069:0:24127:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485913728:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788463764.289112:0:24127:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463764.289215:0:24127:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618c2056540 going to sleep for 11 seconds 00000100:00100000:3.0:1788463764.289404:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485913728 00000100:00100000:3.0:1788463764.289410:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485913728 00000100:00100000:3.0:1788463764.289490:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788463764.289499:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+19:24127:x1875339485913728:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463764.290331:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+19:24127:x1875339485913728:12345-0@lo:502:mount.lustre.0 Request processed in 830us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463764.290340:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788463764.290506:0:24127:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485913728:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788463764.290614:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1788463764.290626:0:24127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788463764.293813:0:24144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788463764.293826:0:24144:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788463764.293834:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463764.293836:0:24144:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788463764.293842:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788463764.293859:0:24144:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff96189165b380) 00000020:00000080:1.0:1788463764.293900:0:24144:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788463764.293918:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788463764.293993:0:24144:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9618c16bd800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788463764.294003:0:24144:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788463764.294011:0:24144:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x841acb7f42a3b3c0 00010000:00010000:1.0:1788463764.308025:0:24144:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1788463764.313709:0:24144:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:0.0:1788463764.320905:0:24144:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1788463764.332731:0:24144:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788463764.332744:0:24144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463764.332751:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463764.332753:0:24144:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788463764.332757:0:24144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788463764.332760:0:24144:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1788463764.332762:0:24144:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788463764.332763:0:24144:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788463764.332765:0:24144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788463764.332767:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463764.332783:0:24144:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788463764.332787:0:24144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463764.332791:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463764.332793:0:24144:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788463764.332796:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788463764.332798:0:24144:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788463764.332800:0:24144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463764.332803:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463764.332804:0:24144:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788463764.332807:0:24144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463764.332809:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463764.332811:0:24144:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788463764.332814:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788463764.332848:0:24144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463764.332851:0:24144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463764.332853:0:24144:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788463764.332856:0:24144:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:1.0:1788463764.341060:0:24127:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788463764.341142:0:24127:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788463764.341186:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4000/0x841acb7f42a3b3ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b3b2 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.341199:0:24127:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff96188f6f4000/0x841acb7f42a3b3ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b3b2 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463764.341237:0:24127:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9618c16bd800 from 1 10000000:01000000:1.0:1788463764.341240:0:24127:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788463764.341279:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b3c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.341286:0:24127:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b3c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.341297:0:24127:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b3c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463764.341322:0:24127:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485913856:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788463764.341385:0:24127:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463764.341420:0:24127:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f578480 going to sleep for 11 seconds 00000100:00100000:3.0:1788463764.341923:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485913856 00000100:00100000:3.0:1788463764.341931:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485913856 00000100:00100000:3.0:1788463764.341989:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788463764.341999:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+19:24127:x1875339485913856:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463764.342012:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463764.342025:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961882813a00/0x841acb7f42a3b3ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b3c7 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463764.342049:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961882813a00/0x841acb7f42a3b3ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b3c7 expref: 20 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463764.342059:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961882813a00/0x841acb7f42a3b3ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b3c7 expref: 20 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463764.342068:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882813a00, rc 0) 00000100:00100000:3.0:1788463764.342111:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+20:24127:x1875339485913856:12345-0@lo:101:mount.lustre.0 Request processed in 111us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463764.342117:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788463764.342349:0:24127:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485913856:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788463764.342364:0:24127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b3c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b3ce expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.342386:0:24127:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b3c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b3ce expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788463764.345738:0:24127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1788463764.346075:0:24127:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788463764.347035:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788463764.347067:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788463764.347081:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788463764.347093:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1788463764.347104:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1788463764.347115:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1788463764.347125:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1788463764.347137:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1788463764.347166:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1788463764.347180:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1788463764.347191:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1788463764.347207:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1788463764.347211:0:24127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1788463764.347294:0:24127:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485913984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463764.347363:0:24127:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463764.347398:0:24127:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f578e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788463764.349451:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485913984 00000100:00100000:3.0:1788463764.349464:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485913984 00000100:00100000:3.0:1788463764.349520:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788463764.349531:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+20:24127:x1875339485913984:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463764.349711:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+20:24127:x1875339485913984:12345-0@lo:501:mount.lustre.0 Request processed in 182us (2346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463764.349730:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788463764.349768:0:24127:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485913984:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463764.349822:0:24127:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad769180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485914112:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788463764.349887:0:24127:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463764.350136:0:24127:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618853f7300 going to sleep for 11 seconds 00000100:00100000:3.0:1788463764.350811:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485914112 00000100:00100000:3.0:1788463764.350818:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485914112 00000100:00100000:3.0:1788463764.350852:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788463764.350871:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+20:24127:x1875339485914112:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788463764.350981:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+20:24127:x1875339485914112:12345-0@lo:503:mount.lustre.0 Request processed in 121us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463764.350988:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788463764.351549:0:24127:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad769180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485914112:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788463764.352095:0:24127:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788463764.354596:0:24127:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485914240:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788463764.354705:0:24127:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463764.354752:0:24127:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f578480 going to sleep for 11 seconds 00000100:00100000:3.0:1788463764.355241:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485914240 00000100:00100000:3.0:1788463764.355250:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485914240 00000100:00100000:3.0:1788463764.355312:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788463764.355331:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+20:24127:x1875339485914240:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463764.355490:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+20:24127:x1875339485914240:12345-0@lo:502:mount.lustre.0 Request processed in 160us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463764.355498:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788463764.355767:0:24127:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485914240:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788463764.356078:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788463764.356110:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788463764.356124:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788463764.356136:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788463764.356148:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788463764.356161:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788463764.356176:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788463764.356189:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1788463764.356201:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788463764.356215:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1788463764.356228:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1788463764.356272:0:24127:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485914368:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788463764.356336:0:24127:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463764.356368:0:24127:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618853f7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788463764.356407:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485914368 00000100:00100000:3.0:1788463764.356414:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485914368 00000100:00100000:3.0:1788463764.356462:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788463764.356470:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+20:24127:x1875339485914368:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463764.356567:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+20:24127:x1875339485914368:12345-0@lo:502:mount.lustre.0 Request processed in 96us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463764.356604:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788463764.356766:0:24127:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485914368:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788463764.356812:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1788463764.356820:0:24127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000100:00100000:0.0:1788463764.357679:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485914496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463764.357729:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788463764.358042:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463764.358053:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463764.358056:0:24148:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788463764.358062:0:24148:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9618c16bd800 00000020:00000080:3.0:1788463764.358071:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788463764.358080:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463764.358083:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463764.358084:0:24148:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788463764.358087:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463764.358089:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463764.358091:0:24148:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788463764.358094:0:24148:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9618c16bd800 00000020:00000080:3.0:1788463764.358096:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788463764.358160:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463764.358163:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463764.358165:0:24148:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788463764.358167:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463764.358170:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463764.358171:0:24148:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788463764.358174:0:24148:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9618c16bd800 00000020:00000080:3.0:1788463764.358176:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788463764.358206:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463764.358209:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463764.358210:0:24148:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788463764.358212:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463764.358215:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463764.358216:0:24148:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788463764.358219:0:24148:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9618c16bd800 00000020:00000080:3.0:1788463764.358221:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788463764.358244:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463764.358247:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463764.358248:0:24148:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788463764.358251:0:24148:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000100:00100000:1.0:1788463764.358485:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485914496 00000100:00100000:1.0:1788463764.358492:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485914496 00000100:00100000:1.0:1788463764.358545:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788463764.358556:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cfe9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485914496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788463764.358617:0:22631:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788463764.358667:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cfe9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485914496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463764.358675:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:01000000:1.0:1788463764.358698:0:24127:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788463764.358725:0:24127:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788463764.358737:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b3c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b3ce expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.358749:0:24127:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b3c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b3ce expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463764.358808:0:24127:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788463764.358811:0:24127:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9618c16bd800 10000000:01000000:1.0:1788463764.358815:0:24127:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9618c16bd800 10000000:01000000:1.0:1788463764.358819:0:24127:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788463764.358825:0:24127:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9618c16bd800 from 1 10000000:01000000:1.0:1788463764.358827:0:24127:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788463764.358856:0:24127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdec00/0x841acb7f42a3b3d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.358875:0:24127:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961786bdec00/0x841acb7f42a3b3d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.358885:0:24127:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961786bdec00/0x841acb7f42a3b3d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463764.358902:0:24127:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485914624:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788463764.358945:0:24127:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463764.358971:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485914624 00000100:00100000:1.0:1788463764.358975:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485914624 00000100:00100000:1.0:1788463764.359001:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788463764.359008:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+20:24127:x1875339485914624:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788463764.359018:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463764.359032:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961786bdf600/0x841acb7f42a3b3dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b3d5 expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.359057:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961786bdf600/0x841acb7f42a3b3dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b3d5 expref: 21 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.359067:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961786bdf600/0x841acb7f42a3b3dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b3d5 expref: 21 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.359076:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdf600, rc 0) 00000100:00100000:1.0:1788463764.359105:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:24127:x1875339485914624:12345-0@lo:101:mount.lustre.0 Request processed in 97us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463764.359112:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788463764.359120:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfe8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485914752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463764.359150:0:24127:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f578c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788463764.359170:0:24127:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485914624:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788463764.359183:0:24127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961786bdec00/0x841acb7f42a3b3d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b3dc expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.359192:0:24127:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961786bdec00/0x841acb7f42a3b3d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b3dc expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463764.359317:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463764.359366:0:23368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485914752 00000100:00100000:0.0:1788463764.359371:0:23368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485914752 00000100:00100000:0.0:1788463764.359400:0:23368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788463764.359407:0:23368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cfeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485914752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788463764.359428:0:23368:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788463764.359938:0:23368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cfeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485914752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 530us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463764.359946:0:23368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788463764.360011:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485914496:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463764.362630:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfe8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485914752:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1788463764.382342:0:24127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1788463764.382872:0:24127:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788463764.383107:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788463764.383135:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788463764.383269:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788463764.383291:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788463764.383308:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788463764.383321:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788463764.383335:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788463764.383360:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788463764.383375:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788463764.383387:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788463764.383416:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788463764.383433:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788463764.383446:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788463764.383458:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788463764.383471:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788463764.383485:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788463764.383501:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788463764.383516:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788463764.383532:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788463764.383547:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788463764.383562:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788463764.383600:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788463764.383617:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788463764.383633:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788463764.383647:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1788463764.383658:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1788463764.383685:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1788463764.383701:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1788463764.383722:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1788463764.383735:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1788463764.383747:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1788463764.383761:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1788463764.383773:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1788463764.383789:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1788463764.383805:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1788463764.383821:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1788463764.383834:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1788463764.383846:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1788463764.383869:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1788463764.383886:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1788463764.383910:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1788463764.383924:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1788463764.383956:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1788463764.383975:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1788463764.383988:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1788463764.384001:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1788463764.384017:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1788463764.384030:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1788463764.385391:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1788463764.385442:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1788463764.385466:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1788463764.385472:0:24127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1788463764.385600:0:24127:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485914880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463764.385674:0:24127:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463764.385792:0:24127:0:(client.c:2716:ptlrpc_set_wait()) set ffff961883659780 going to sleep for 11 seconds 00000100:00100000:1.0:1788463764.391126:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485914880 00000100:00100000:1.0:1788463764.391142:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485914880 00000100:00100000:1.0:1788463764.391202:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788463764.391213:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:24127:x1875339485914880:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463764.391528:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:24127:x1875339485914880:12345-0@lo:501:mount.lustre.0 Request processed in 316us (5853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463764.391536:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788463764.391639:0:24127:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485914880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463764.391695:0:24127:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485915008:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788463764.391743:0:24127:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463764.391775:0:24127:0:(client.c:2716:ptlrpc_set_wait()) set ffff961883659780 going to sleep for 11 seconds 00000100:00100000:3.0:1788463764.392435:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485915008 00000100:00100000:3.0:1788463764.392443:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485915008 00000100:00100000:3.0:1788463764.392482:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788463764.392494:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:24127:x1875339485915008:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788463764.393407:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:24127:x1875339485915008:12345-0@lo:503:mount.lustre.0 Request processed in 913us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463764.393418:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788463764.393745:0:24127:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485915008:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788463764.397198:0:24127:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788463764.397301:0:24127:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485915136:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788463764.397382:0:24127:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463764.397436:0:24127:0:(client.c:2716:ptlrpc_set_wait()) set ffff961883659780 going to sleep for 11 seconds 00000100:00100000:0.0:1788463764.397972:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485915136 00000100:00100000:0.0:1788463764.397980:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485915136 00000100:00100000:0.0:1788463764.398029:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788463764.398038:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:24127:x1875339485915136:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788463764.398220:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:24127:x1875339485915136:12345-0@lo:502:mount.lustre.0 Request processed in 182us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463764.398229:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788463764.398787:0:24127:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485915136:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788463764.399041:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788463764.399080:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1788463764.399113:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1788463764.400337:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1788463764.400383:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1788463764.400409:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1788463764.400432:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1788463764.400454:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1788463764.400476:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788463764.400497:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1788463764.400516:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1788463764.400532:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1788463764.400549:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1788463764.400568:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1788463764.400772:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1788463764.400796:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1788463764.400817:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1788463764.400838:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1788463764.400868:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1788463764.400909:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1788463764.400927:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1788463764.400940:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1788463764.400955:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1788463764.400970:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1788463764.400989:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1788463764.401007:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1788463764.401024:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1788463764.401041:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1788463764.401056:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1788463764.401073:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1788463764.401093:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1788463764.401111:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1788463764.401129:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1788463764.401873:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1788463764.403341:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1788463764.403367:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1788463764.403383:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1788463764.403397:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1788463764.403413:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1788463764.403429:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1788463764.403443:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1788463764.403460:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1788463764.403477:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1788463764.403491:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1788463764.403508:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1788463764.403523:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1788463764.403537:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1788463764.403552:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1788463764.404737:0:24127:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485915264:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463764.404821:0:24127:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463764.404915:0:24127:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788463764.406791:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485915264 00000100:00100000:2.0:1788463764.406814:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485915264 00000100:00100000:2.0:1788463764.406891:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788463764.406904:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:24127:x1875339485915264:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788463764.407080:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:24127:x1875339485915264:12345-0@lo:502:mount.lustre.0 Request processed in 179us (2257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463764.407091:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788463764.407456:0:24127:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485915264:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788463764.407771:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1788463764.407804:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1788463764.407845:0:24127:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485915392:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463764.407910:0:24127:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463764.407952:0:24127:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788463764.408159:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485915392 00000100:00100000:1.0:1788463764.408166:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485915392 00000100:00100000:1.0:1788463764.408208:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788463764.408218:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:24127:x1875339485915392:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788463764.408330:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:24127:x1875339485915392:12345-0@lo:502:mount.lustre.0 Request processed in 112us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463764.408337:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788463764.408366:0:24127:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485915392:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788463764.408415:0:24127:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1788463764.408423:0:24127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788463764.409704:0:24154:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788463764.409722:0:24154:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff96188d800000) 00000020:00000080:2.0:1788463764.409745:0:24154:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1788463764.409881:0:24154:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9618c16bd800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788463764.409885:0:24154:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9618c16bd800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788463764.409887:0:24154:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9618c16bd800 3 00010000:00080000:2.0:1788463764.409919:0:24154:0:(ldlm_lib.c:102:import_set_conn()) imp ffff961788572000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.153@tcp at head 00010000:00010000:2.0:1788463764.411527:0:24154:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1788463764.411750:0:24154:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788463764.411796:0:24154:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788463764.411808:0:24154:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x841acb7f42a3b3ea 00000100:00080000:2.0:1788463764.411819:0:24154:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788463764.411824:0:24154:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff961788572000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:2.0:1788463764.411874:0:24154:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9618ad76b800 x1875339485915520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788463764.411914:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875339485915520:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788463764.411985:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463764.412044:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485915520 00000100:00100000:2.0:1788463764.412051:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485915520 00000100:00100000:2.0:1788463764.412083:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788463764.412090:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad76bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875339485915520:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788463764.412114:0:22628:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 803 last 0 00000020:00000080:2.0:1788463764.412154:0:22628:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x841acb7f42a3b3f1 00000004:00100000:2.0:1788463764.412169:0:22628:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788463764.412202:0:22628:0:(import.c:65:import_set_state_nolock()) ffff961788575000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788463764.412256:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad76bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875339485915520:12345-0@lo:38:llog_process_th.0 Request processed in 164us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463764.412264:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788463764.412304:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9618ad76b800 x1875339485915520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788463774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463764.412314:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788463764.412322:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1788463764.412328:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788463764.412332:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788463764.412334:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961788572000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788463764.412340:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875339485915520:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788463764.412360:0:24154:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788463764.412383:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788463764.412387:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788463764.412390:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788463764.412393:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788463764.412427:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788463764.412431:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788463764.413350:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485915648:0@lo:400:kworker.0 00000100:00100000:0.0:1788463764.413397:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463764.415288:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485915648 00000100:00100000:1.0:1788463764.415299:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485915648 00000100:00100000:1.0:1788463764.415352:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788463764.415362:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cfe8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485915648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463764.415441:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cfe8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485915648:12345-0@lo:400:kworker.0 Request processed in 81us (2043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463764.415448:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788463764.415520:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788463764.415525:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788463764.415628:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485915776:0@lo:400:kworker.0 00000100:00100000:2.0:1788463764.415665:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463764.415708:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485915776 00000100:00100000:2.0:1788463764.415712:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485915776 00000100:00100000:2.0:1788463764.415737:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788463764.415743:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485915776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463764.415776:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485915776:12345-0@lo:400:kworker.0 Request processed in 33us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463764.415783:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788463764.415815:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9618ad76a680 x1875339485915776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463764.415829:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485915776:0@lo:400:kworker.0 00010000:00080000:0.0:1788463764.416085:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9618ad76b800 x1875339485915648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463764.416096:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485915648:0@lo:400:kworker.0 00000020:01000004:2.0:1788463764.416343:0:24154:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788463764.416359:0:24154:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff96188d804d40) 00000020:00000080:2.0:1788463764.416381:0:24154:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1788463764.416466:0:24154:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9618c16bd800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788463764.416471:0:24154:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9618c16bd800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788463764.416473:0:24154:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9618c16bd800 3 00010000:00080000:2.0:1788463764.416500:0:24154:0:(ldlm_lib.c:102:import_set_conn()) imp ffff961788576800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.153@tcp at head 00010000:00010000:2.0:1788463764.419009:0:24154:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1788463764.419233:0:24154:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788463764.419282:0:24154:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788463764.419297:0:24154:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x841acb7f42a3b3ff 00000100:00080000:2.0:1788463764.419307:0:24154:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788463764.419314:0:24154:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff961788576800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:2.0:1788463764.419349:0:24154:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9618ad76a680 x1875339485915904/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788463764.419404:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875339485915904:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788463764.419480:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463764.419549:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485915904 00000100:00100000:2.0:1788463764.419556:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485915904 00000100:00100000:2.0:1788463764.419619:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788463764.419627:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875339485915904:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788463764.419652:0:22627:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 803 last 0 00000020:00000080:2.0:1788463764.419680:0:22627:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x841acb7f42a3b406 00000004:00100000:2.0:1788463764.419695:0:22627:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788463764.419725:0:22627:0:(import.c:65:import_set_state_nolock()) ffff961788573000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788463764.419777:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875339485915904:12345-0@lo:38:llog_process_th.0 Request processed in 149us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463764.419784:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788463764.419823:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9618ad76a680 x1875339485915904/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788463774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463764.419833:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788463764.419841:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1788463764.420930:0:24154:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788463764.421257:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788463764.421265:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788463764.421269:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961788576800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788463764.421277:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875339485915904:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788463764.421314:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788463764.421319:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788463764.421321:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788463764.421330:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788463764.421334:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788463764.421336:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788463764.421339:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788463764.421342:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1788463764.422349:0:24154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1788463764.422412:0:24127:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788463764.422459:0:24127:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788463764.422477:0:24127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdec00/0x841acb7f42a3b3d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b3dc expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463764.422490:0:24127:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961786bdec00/0x841acb7f42a3b3d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b3dc expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788463764.422535:0:24127:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788463764.422537:0:24127:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788463764.422539:0:24127:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788463764.422540:0:24127:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788463764.422542:0:24127:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788463764.422543:0:24127:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788463764.422545:0:24127:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788463764.422547:0:24127:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788463764.422548:0:24127:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788463764.422553:0:24127:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788463764.422556:0:24127:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788463764.422557:0:24127:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788463764.422558:0:24127:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788463764.422560:0:24127:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788463764.422561:0:24127:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788463764.422562:0:24127:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788463764.422564:0:24127:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788463764.422565:0:24127:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788463764.422566:0:24127:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788463764.422628:0:24127:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788463764.422646:0:24127:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485916032:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788463764.422713:0:24127:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463764.422755:0:24127:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e0000 going to sleep for 11 seconds 00000100:00100000:1.0:1788463764.422811:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485916032 00000100:00100000:1.0:1788463764.422820:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485916032 00000100:00100000:1.0:1788463764.422878:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788463764.422890:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961885030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:24127:x1875339485916032:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788463764.422915:0:22621:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788463764.422935:0:22621:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788463764.431952:0:22621:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788463764.431975:0:22621:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788463764.432072:0:22642:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788463764.432077:0:22642:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788463764.432102:0:22642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff961786bde000/0x841acb7f42a3b40d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.432121:0:22642:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961785e21e00/0x841acb7f42a3b357 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b350 expref: 21 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.432130:0:22642:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961785e20200/0x841acb7f42a3b365 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b35e expref: 21 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.432137:0:22642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff961786bde000/0x841acb7f42a3b40d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.432183:0:22642:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961785e20200/0x841acb7f42a3b365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3b35e expref: 21 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.432197:0:22642:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff961785e20200/0x841acb7f42a3b365 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3b35e expref: 21 pid: 22621 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463764.432211:0:22642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22642:1875339485916160:0@lo:104: 00000100:00100000:1.0:1788463764.432285:0:22642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788463764.432347:0:22642:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961785e21e00/0x841acb7f42a3b357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3b350 expref: 21 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.432356:0:22642:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff961785e21e00/0x841acb7f42a3b357 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3b350 expref: 21 pid: 22618 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463764.432364:0:22642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22642:1875339485916288:0@lo:104: 00000100:00100000:1.0:1788463764.432386:0:22642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463764.432412:0:22642:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f578840 going to sleep for 11 seconds 00000100:00100000:1.0:1788463764.432476:0:22609:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788463764.432493:0:22609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485916160 00000100:00100000:1.0:1788463764.432499:0:22609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485916160 00000100:00100000:1.0:1788463764.432529:0:22609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485916288 00000100:00100000:1.0:1788463764.432532:0:22609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485916288 00000100:00100000:1.0:1788463764.432545:0:22609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788463764.432552:0:22609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:abd83a7b-f7e3-4d68-aade-6298a66ab956+4:22642:x1875339485916160:12345-0@lo:104: 00010000:00010000:1.0:1788463764.432564:0:22609:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff96188f6f4400/0x841acb7f42a3b35e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3b365 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.432636:0:22609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788463764.432643:0:22609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:abd83a7b-f7e3-4d68-aade-6298a66ab956+4:22642:x1875339485916160:12345-0@lo:104: Request processed in 91us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463764.432649:0:22609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788463764.432665:0:22609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788463764.432671:0:22609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:abd83a7b-f7e3-4d68-aade-6298a66ab956+3:22642:x1875339485916288:12345-0@lo:104: 00010000:00010000:1.0:1788463764.432679:0:22609:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff9618be00fe00/0x841acb7f42a3b350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3b357 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.432707:0:22609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788463764.432712:0:22609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:abd83a7b-f7e3-4d68-aade-6298a66ab956+3:22642:x1875339485916288:12345-0@lo:104: Request processed in 41us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463764.432718:0:22609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788463764.432750:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788463764.432756:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff96188f6f4400/0x841acb7f42a3b35e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3b365 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.432763:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4400 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:1.0:1788463764.432773:0:22615:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f4400/0x841acb7f42a3b35e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3b365 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.432782:0:22615:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff96188f6f4400/0x841acb7f42a3b35e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3b365 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463764.432789:0:22615:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f4400/0x841acb7f42a3b35e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3b365 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463764.432794:0:22615:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788463764.432818:0:22615:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff96188f6f4400/0x841acb7f42a3b35e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b365 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.432824:0:22615:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463764.432844:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff96188f6f4400/0x841acb7f42a3b35e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b365 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.432852:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff96188f6f4400/0x841acb7f42a3b35e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b365 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.432989:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463764.432992:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff9618be00fe00/0x841acb7f42a3b350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3b357 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.432998:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618be00fe00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:1.0:1788463764.433002:0:22615:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff9618be00fe00/0x841acb7f42a3b350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3b357 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.433008:0:22615:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff9618be00fe00/0x841acb7f42a3b350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3b357 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463764.433024:0:22615:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff9618be00fe00/0x841acb7f42a3b350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3b357 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463764.433029:0:22615:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788463764.433045:0:22615:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff9618be00fe00/0x841acb7f42a3b350 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b357 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.433051:0:22615:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463764.433066:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff9618be00fe00/0x841acb7f42a3b350 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b357 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.433073:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff9618be00fe00/0x841acb7f42a3b350 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b357 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.433085:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463764.433086:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463764.433088:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463764.433107:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:abd83a7b-f7e3-4d68-aade-6298a66ab956:3651:1875339485916416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463764.433136:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463764.433170:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485916416 00000100:00100000:1.0:1788463764.433174:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485916416 00010000:00010000:1.0:1788463764.433202:0:22613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961785e20200/0x841acb7f42a3b365 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3b35e expref: 22 pid: 22621 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463764.433223:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788463764.433229:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:abd83a7b-f7e3-4d68-aade-6298a66ab956+22:3651:x1875339485916416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788463764.433238:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463764.433243:0:22613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961785e20200/0x841acb7f42a3b365 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3b35e expref: 22 pid: 22621 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.433260:0:22613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961785e20200/0x841acb7f42a3b365 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3b35e expref: 22 pid: 22621 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.433273:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463764.433299:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:abd83a7b-f7e3-4d68-aade-6298a66ab956+22:3651:x1875339485916416:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463764.433306:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788463764.433444:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788463764.433454:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:abd83a7b-f7e3-4d68-aade-6298a66ab956:3649:1875339485916544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463764.433485:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463764.437739:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485916544 00000100:00100000:1.0:1788463764.437755:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485916544 00010000:00010000:1.0:1788463764.437809:0:22613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961785e21e00/0x841acb7f42a3b357 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3b350 expref: 22 pid: 22618 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463764.437841:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788463764.437850:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad1d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:abd83a7b-f7e3-4d68-aade-6298a66ab956+22:3649:x1875339485916544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788463764.437877:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463764.437883:0:22613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961785e21e00/0x841acb7f42a3b357 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3b350 expref: 22 pid: 22618 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.437896:0:22613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961785e21e00/0x841acb7f42a3b357 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3b350 expref: 22 pid: 22618 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.437918:0:22613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff961786bde000/0x841acb7f42a3b40d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.437927:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961786bde000/0x841acb7f42a3b40d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788463764.437945:0:22613:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014293953s 00010000:00010000:1.0:1788463764.437950:0:22613:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961786bde000/0x841acb7f42a3b40d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.437971:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961786bde000/0x841acb7f42a3b40d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.437978:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff961786bde000/0x841acb7f42a3b40d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.437985:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff961786bde000/0x841acb7f42a3b40d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.437992:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463764.437996:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff961786bde000/0x841acb7f42a3b40d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.438004:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff961786bde000/0x841acb7f42a3b40d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.438014:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff961786bde000/0x841acb7f42a3b40d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463764.438024:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463764.438090:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad1d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:abd83a7b-f7e3-4d68-aade-6298a66ab956+22:3649:x1875339485916544:12345-0@lo:103:ldlm_bl.0 Request processed in 242us (4604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463764.438098:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788463764.440408:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961785e20200/0x841acb7f42a3b365 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3b35e expref: 21 pid: 22621 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463764.440431:0:22642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22642:1875339485916160:0@lo:104: 00010000:00010000:3.0:1788463764.440447:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961785e21e00/0x841acb7f42a3b357 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3b350 expref: 20 pid: 22618 timeout: 903 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463764.440456:0:22642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22642:1875339485916288:0@lo:104: 00010000:00010000:3.0:1788463764.440486:0:22642:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff961786bde000/0x841acb7f42a3b40d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463764.440497:0:22642:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff961786bde000/0x841acb7f42a3b40d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463764.440502:0:22642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff961786bde000/0x841acb7f42a3b40d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463764.440509:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961786bde000/0x841acb7f42a3b40d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463764.441037:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463764.441234:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:abd83a7b-f7e3-4d68-aade-6298a66ab956:3651:1875339485916416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463764.443998:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:abd83a7b-f7e3-4d68-aade-6298a66ab956:3649:1875339485916544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463764.444108:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961885030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+19:24127:x1875339485916032:12345-0@lo:253:mount.lustre.0 Request processed in 21219us (21392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463764.444119:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788463764.444423:0:24127:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24127:1875339485916032:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788463764.444437:0:24127:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788463764.444440:0:24127:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788463764.444442:0:24127:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788463764.444443:0:24127:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788463764.444444:0:24127:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788463764.444445:0:24127:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788463764.444447:0:24127:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788463764.444448:0:24127:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788463764.444450:0:24127:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788463764.444451:0:24127:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788463764.444472:0:24127:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:3.0:1788463764.447464:0:24127:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1788463764.450891:0:24127:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788463764.450901:0:24127:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788463764.450940:0:24127:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788463764.450983:0:24127:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.153@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788463764.451000:0:24127:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788463764.451020:0:24127:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788463764.455440:0:24127:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788463764.455686:0:24127:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788463764.484906:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463765.517569:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788463765.593931:0:24208:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788463765.594212:0:24208:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1788463766.219373:0:22623:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788463766.219381:0:22623:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff961787d22000 from 13 10000000:01000000:2.0:1788463766.219387:0:22623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788463766.219442:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e21800/0x841acb7f42a3b414 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463766.219454:0:22623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961785e21800/0x841acb7f42a3b414 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463766.219466:0:22623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961785e21800/0x841acb7f42a3b414 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463766.219496:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485916672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788463766.219981:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463766.223021:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618877e1840 going to sleep for 11 seconds 00000100:00100000:0.0:1788463766.223394:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485916672 00000100:00100000:0.0:1788463766.223407:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485916672 00000100:00100000:0.0:1788463766.223474:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788463766.223485:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+19:22623:x1875339485916672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463766.223504:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463766.223528:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96188f6f4e00/0x841acb7f42a3b41b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b414 expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463766.223599:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96188f6f4e00/0x841acb7f42a3b41b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b414 expref: 20 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463766.223612:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96188f6f4e00/0x841acb7f42a3b41b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b414 expref: 20 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463766.223621:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f4e00, rc 0) 00000100:00100000:0.0:1788463766.223687:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+20:22623:x1875339485916672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (3707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463766.223693:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788463766.223878:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485916672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463766.223895:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961785e21800/0x841acb7f42a3b414 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b41b expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463766.223905:0:22623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961785e21800/0x841acb7f42a3b414 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b41b expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463766.223969:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485916800:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788463766.224010:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463766.224032:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff961884f86780 going to sleep for 11 seconds 00000100:00100000:0.0:1788463766.224085:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485916800 00000100:00100000:0.0:1788463766.224090:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485916800 00000100:00100000:0.0:1788463766.224223:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788463766.224232:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+20:22623:x1875339485916800:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788463766.224248:0:22621:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788463766.224266:0:22621:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788463766.224270:0:22621:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1788463766.224367:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+20:22623:x1875339485916800:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 136us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463766.224374:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788463766.224430:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485916800:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788463766.224500:0:22623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788463766.224507:0:22623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e21800/0x841acb7f42a3b414 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b41b expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463766.224516:0:22623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961785e21800/0x841acb7f42a3b414 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b41b expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463766.224526:0:22623:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788463766.224534:0:22623:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9618bf5d9000 from 13 10000000:01000000:3.0:1788463766.224537:0:22623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788463766.224560:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a3b422 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463766.224568:0:22623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a3b422 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463766.224598:0:22623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a3b422 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463766.224611:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485916928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788463766.224637:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463766.226888:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff961884f86780 going to sleep for 11 seconds 00000100:00100000:2.0:1788463766.227038:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485916928 00000100:00100000:2.0:1788463766.227047:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485916928 00000100:00100000:2.0:1788463766.227091:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788463766.227100:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+20:22623:x1875339485916928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463766.227137:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463766.227155:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961785e20e00/0x841acb7f42a3b429 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b422 expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463766.227184:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961785e20e00/0x841acb7f42a3b429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b422 expref: 21 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463766.227194:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961785e20e00/0x841acb7f42a3b429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b422 expref: 21 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463766.227203:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20e00, rc 0) 00000100:00100000:2.0:1788463766.227272:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:22623:x1875339485916928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (2633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463766.227280:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788463766.227440:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485916928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463766.227457:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a3b422 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b429 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463766.227467:0:22623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a3b422 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b429 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463766.227523:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485917056:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788463766.227559:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463766.227568:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff961884f86780 going to sleep for 11 seconds 00000100:00100000:2.0:1788463766.227655:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485917056 00000100:00100000:2.0:1788463766.227659:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485917056 00000100:00100000:2.0:1788463766.227675:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788463766.227681:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:22623:x1875339485917056:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788463766.227694:0:22618:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788463766.227710:0:22618:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788463766.227714:0:22618:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1788463766.227797:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:22623:x1875339485917056:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463766.227804:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788463766.227874:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485917056:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788463766.227934:0:22623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788463766.227943:0:22623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a3b422 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b429 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463766.227966:0:22623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a3b422 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b429 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463766.534793:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463767.556723:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463768.579900:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463769.475985:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfe9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485917184:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788463769.476071:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463769.476450:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485917184 00000100:00100000:3.0:1788463769.476458:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485917184 00000100:00100000:3.0:1788463769.476501:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788463769.476510:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cfebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485917184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788463769.476542:0:22632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788463769.476664:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cfebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485917184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 155us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463769.476671:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788463769.477397:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfe9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485917184:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788463769.478513:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788463769.478529:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485917312:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463769.478646:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463769.478892:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485917312 00000100:00100000:0.0:1788463769.478900:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485917312 00000100:00100000:0.0:1788463769.478963:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788463769.478973:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad76b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485917312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788463769.479008:0:22631:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788463769.479069:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad76b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485917312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463769.479075:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788463769.479115:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463769.479118:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788463769.479121:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463769.479123:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788463769.479141:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463769.479143:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788463769.479146:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463769.479148:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788463769.479178:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485917696:0@lo:400:kworker.0 00000100:00100000:0.0:1788463769.479206:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463769.479242:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788463769.479248:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485917568:0@lo:400:kworker.0 00000100:00100000:0.0:1788463769.479817:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463769.479849:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485917696 00000100:00100000:0.0:1788463769.479854:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485917696 00000100:00100000:0.0:1788463769.479882:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485917568 00000100:00100000:0.0:1788463769.479884:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485917568 00000100:00100000:0.0:1788463769.479898:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788463769.479905:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cfeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485917696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463769.479953:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cfeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485917696:12345-0@lo:400:kworker.0 Request processed in 48us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463769.479960:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788463769.479973:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788463769.479979:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cfe8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485917568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463769.480008:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cfe8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485917568:12345-0@lo:400:kworker.0 Request processed in 29us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463769.480014:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788463769.480046:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188cfeb800 x1875339485917568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463769.480167:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfe8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485917824:0@lo:400:kworker.0 00000100:00100000:3.0:1788463769.480201:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463769.480234:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788463769.480241:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfe9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:abd83a7b-f7e3-4d68-aade-6298a66ab956:3650:1875339485917440:0@lo:400:kworker.0 00000100:00100000:3.0:1788463769.480281:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463769.480304:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485917952:0@lo:400:kworker.0 00000100:00100000:3.0:1788463769.480327:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463769.480346:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485917824 00000100:00100000:3.0:1788463769.480349:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485917824 00000100:00100000:3.0:1788463769.480376:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485917952 00000100:00100000:3.0:1788463769.480378:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485917952 00000100:00100000:3.0:1788463769.480816:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788463769.480825:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485917824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463769.480867:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485917824:12345-0@lo:400:kworker.0 Request processed in 43us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463769.480880:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788463769.480896:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788463769.480902:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485917952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463769.480930:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485917952:12345-0@lo:400:kworker.0 Request processed in 29us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463769.480935:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788463769.480967:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188cfead80 x1875339485917952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463769.480979:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485917952:0@lo:400:kworker.0 00010000:00080000:3.0:1788463769.480988:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188cfe8380 x1875339485917824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463769.480997:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfe8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485917824:0@lo:400:kworker.0 00000100:00100000:0.0:1788463769.481376:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485917568:0@lo:400:kworker.0 00000100:00100000:2.0:1788463769.481612:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485917440 00000100:00100000:2.0:1788463769.481628:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485917440 00000100:00100000:2.0:1788463769.481673:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788463769.481682:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:3650:x1875339485917440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463769.481743:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:3650:x1875339485917440:12345-0@lo:400:kworker.0 Request processed in 63us (1461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463769.481749:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1788463769.481808:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788463769.481812:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463769.481851:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485917312:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463769.481877:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfe9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:abd83a7b-f7e3-4d68-aade-6298a66ab956:3650:1875339485917440:0@lo:400:kworker.0 00010000:00080000:0.0:1788463769.482490:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188cfeb100 x1875339485917696/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463769.482502:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485917696:0@lo:400:kworker.0 00010000:00010000:1.0:1788463769.604993:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788463770.314469:0:23381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788463770.627780:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463771.653652:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788463771.720321:0:24498:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg453-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788463772.688259:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788463772.817201:0:24550:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788463772.817403:0:24550:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788463773.645797:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463758/real 1788463758] req@ffff96188fc20a80 x1875339485911680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463773 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463773.645830:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96188fc20a80 x1875339485911680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463773 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463773.645840:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463758/real 1788463758] req@ffff96188fc21180 x1875339485911808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463773 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463773.645850:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96188fc21180 x1875339485911808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463773 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788463773.645869:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188d0ed800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788463773.645894:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788463773.645899:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485911680:0@lo:8:kworker.0 00000100:00080000:1.0:1788463773.645905:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961882e02800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788463773.645911:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788463773.645913:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485911808:0@lo:8:kworker.0 00000100:00080000:3.0:1788463773.647322:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788463773.647329:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788463773.647332:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788463773.647335:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788463773.647360:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788463773.647364:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788463773.647367:0:36:0:(import.c:65:import_set_state_nolock()) ffff96188d0ed800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788463773.647373:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 797 00000100:00080000:3.0:1788463773.647379:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788463773.647392:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff96188d0ed800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463773.647416:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188d1c3100 x1875339485918592/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788463773.647431:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788463773.647434:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788463773.647435:0:36:0:(import.c:65:import_set_state_nolock()) ffff961882e02800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788463773.647438:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 797 00000100:00080000:3.0:1788463773.647442:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788463773.647445:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff961882e02800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463773.647455:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188d1c2a00 x1875339485918720/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788463773.647500:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:abd83a7b-f7e3-4d68-aade-6298a66ab956:3648:1875339485918080:0@lo:400:kworker.0 00000100:00100000:3.0:1788463773.647571:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463773.647631:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485918848:0@lo:400:kworker.0 00000100:00100000:3.0:1788463773.647658:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463773.647695:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788463773.647702:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485918208:0@lo:400:kworker.0 00000100:00100000:3.0:1788463773.647728:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463773.647747:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485918976:0@lo:400:kworker.0 00000100:00100000:3.0:1788463773.647765:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463773.647793:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485918336:0@lo:400:kworker.0 00000100:00100000:3.0:1788463773.647816:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463773.647833:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485919104:0@lo:400:kworker.0 00000100:00100000:3.0:1788463773.647853:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463773.647875:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463773.647880:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485918464:0@lo:400:kworker.0 00000100:00100000:3.0:1788463773.647906:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463773.647940:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485918848 00000100:00100000:3.0:1788463773.647947:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485918848 00000100:00100000:3.0:1788463773.647994:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485918976 00000100:00100000:3.0:1788463773.647998:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485918976 00000100:00100000:3.0:1788463773.648022:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485918336 00000100:00100000:3.0:1788463773.648025:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485918336 00000100:00100000:3.0:1788463773.648037:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485919104 00000100:00100000:3.0:1788463773.648039:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485919104 00000100:00100000:3.0:1788463773.648055:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788463773.648063:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485918848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463773.648112:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485918848:12345-0@lo:400:kworker.0 Request processed in 48us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463773.648119:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788463773.648135:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788463773.648141:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485918976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463773.648168:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485918976:12345-0@lo:400:kworker.0 Request processed in 27us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463773.648173:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788463773.648184:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788463773.648189:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d110700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485918336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463773.648218:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d110700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485918336:12345-0@lo:400:kworker.0 Request processed in 29us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463773.648224:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788463773.648236:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788463773.648243:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d113480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485919104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463773.648278:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d113480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485919104:12345-0@lo:400:kworker.0 Request processed in 38us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463773.648284:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788463773.648303:0:23368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485918208 00000100:00100000:3.0:1788463773.648306:0:23368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485918208 00000100:00100000:3.0:1788463773.648329:0:23368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485918464 00000100:00100000:3.0:1788463773.648332:0:23368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485918464 00000100:00100000:3.0:1788463773.648345:0:23368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788463773.648350:0:23368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485918208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463773.648381:0:23368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485918208:12345-0@lo:400:kworker.0 Request processed in 30us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463773.648386:0:23368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788463773.648398:0:23368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788463773.648403:0:23368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485918464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463773.648428:0:23368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485918464:12345-0@lo:400:kworker.0 Request processed in 25us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463773.648433:0:23368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788463773.648455:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788463773.648459:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463773.648484:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485918208:0@lo:400:kworker.0 00010000:00080000:3.0:1788463773.648496:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d1c2300 x1875339485918976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463773.648505:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485918976:0@lo:400:kworker.0 00010000:00080000:3.0:1788463773.648513:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d1c3480 x1875339485918848/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463773.648521:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485918848:0@lo:400:kworker.0 00000100:00100000:3.0:1788463773.648556:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485918464:0@lo:400:kworker.0 00010000:00080000:3.0:1788463773.648566:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d1c0380 x1875339485918336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463773.648594:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485918336:0@lo:400:kworker.0 00010000:00080000:3.0:1788463773.648605:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d1c2d80 x1875339485919104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463773.648611:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485919104:0@lo:400:kworker.0 00000100:00100000:1.0:1788463773.648711:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485918592:0@lo:8:kworker.0 00000100:00100000:1.0:1788463773.648749:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463773.648775:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485918720:0@lo:8:kworker.0 00000100:00100000:1.0:1788463773.648812:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463773.648843:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485918080 00000100:00100000:1.0:1788463773.648847:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485918080 00000100:00100000:1.0:1788463773.648884:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788463773.648891:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:3648:x1875339485918080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463773.648925:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:3648:x1875339485918080:12345-0@lo:400:kworker.0 Request processed in 34us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463773.648931:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788463773.649858:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485918592 00000100:00100000:2.0:1788463773.649866:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485918592 00000100:00100000:2.0:1788463773.649899:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485918720 00000100:00100000:2.0:1788463773.649902:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485918720 00000100:00100000:2.0:1788463773.649914:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788463773.649920:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1875339485918592:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788463773.649948:0:24133:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 813 last 0 00000020:00000080:2.0:1788463773.650051:0:24133:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x841acb7f42a3b430 00002000:00100000:2.0:1788463773.650065:0:24133:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff961788571000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788463773.650070:0:24133:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788463773.650072:0:24133:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788463773.650258:0:24133:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788463773.650284:0:24133:0:(import.c:65:import_set_state_nolock()) ffff961788576000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788463773.650471:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:abd83a7b-f7e3-4d68-aade-6298a66ab956:3648:1875339485918080:0@lo:400:kworker.0 00000100:00100000:2.0:1788463773.650537:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1875339485918592:12345-0@lo:8:kworker.0 Request processed in 615us (1786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463773.650544:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788463773.650568:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788463773.650605:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1875339485918720:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788463773.650618:0:24133:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1788463773.657434:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d1c3100 x1875339485918592/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788463793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463773.657451:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788463773.657536:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788463773.657549:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788463773.657556:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788463773.657561:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188d0ed800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788463773.657595:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788463773.657602:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485918592:0@lo:8:kworker.0 00000004:00080000:0.0:1788463773.658566:0:23370:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788463773.658614:0:23370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfeb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23370:1875339485919360:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788463773.658699:0:23370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463773.658729:0:23370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618991e5cc0 going to sleep for 11 seconds 00000004:00080000:0.0:1788463773.658747:0:23369:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788463773.658838:0:23369:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 813110262851ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788463773.658845:0:23369:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788463773.658873:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463773.658897:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485919232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788463773.658925:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463773.658961:0:24131:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788463773.658968:0:24131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788463773.667172:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485919360 00000100:00100000:0.0:1788463773.667187:0:24131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485919360 00000100:00080000:0.0:1788463773.667252:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463773.670167:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788463773.670187:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cfe9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23370:x1875339485919360:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788463773.674037:0:23360:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:3.0:1788463773.677358:0:24581:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1788463773.677368:0:24581:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1788463773.677516:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cfe9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23370:x1875339485919360:12345-0@lo:7:osp-pre-0-1.0 Request processed in 7331us (18812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463773.677527:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788463773.684079:0:23370:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188cfeb800 x1875339485919360/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788463789 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463773.684098:0:23370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfeb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23370:1875339485919360:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788463773.684114:0:23370:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788463773.684160:0:23370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfeb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23370:1875339485919488:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788463773.684243:0:23370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463773.684389:0:23370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618991e5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463773.688063:0:24135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485919232 00000100:00100000:1.0:1788463773.688077:0:24135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485919232 00000100:00100000:1.0:1788463773.688124:0:24135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788463773.688133:0:24135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cfe8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875339485919232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788463773.688175:0:24135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788463773.688251:0:24135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cfe8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875339485919232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (29325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463773.688258:0:24135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788463773.688304:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188cfeb100 x1875339485919232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463789 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463773.688325:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485919232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463773.691208:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485919488 00000100:00100000:3.0:1788463773.691222:0:24131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485919488 00000100:00100000:3.0:1788463773.691296:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788463773.691308:0:24131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cfead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23370:x1875339485919488:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788463773.691345:0:24131:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1788463773.691433:0:24131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cfead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23370:x1875339485919488:12345-0@lo:5:osp-pre-0-1.0 Request processed in 128us (7189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463773.691440:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788463773.691525:0:23370:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188cfeb800 x1875339485919488/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788463789 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463773.691556:0:23370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfeb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23370:1875339485919488:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788463773.691571:0:23370:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788463773.691633:0:23370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23370:1875339485919616:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788463773.691690:0:23370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463773.691714:0:23370:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c66d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788463773.692394:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485919616 00000100:00100000:0.0:1788463773.692403:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485919616 00000100:00100000:0.0:1788463773.692450:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788463773.692459:0:24134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23370:x1875339485919616:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788463773.692492:0:24134:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:2.0:1788463773.706467:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1875339485918720:12345-0@lo:8:kworker.0 Request processed in 55850us (57643us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788463773.706483:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788463773.707191:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961882e02800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788463773.707198:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788463773.707202:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485918720:0@lo:8:kworker.0 00010000:00010000:1.0:1788463773.707264:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788463773.737168:0:24128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:2.0:1788463773.737181:0:24128:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788463773.737516:0:24134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23370:x1875339485919616:12345-0@lo:5:osp-pre-0-1.0 Request processed in 45054us (45831us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788463773.737527:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788463773.737893:0:23370:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188fc23480 x1875339485919616/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788463789 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463773.737905:0:23370:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1788463773.737911:0:23370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23370:1875339485919616:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788463773.737926:0:23370:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:2.0:1788463773.737990:0:23370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23370:1875339485919744:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788463773.738028:0:23370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463773.738055:0:23370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618830b89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463773.741795:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485919744 00000100:00100000:0.0:1788463773.741810:0:22638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485919744 00000100:00100000:0.0:1788463773.741863:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788463773.741875:0:22638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad76a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23370:x1875339485919744:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788463773.741989:0:22638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad76a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23370:x1875339485919744:12345-0@lo:900:osp-pre-0-1.0 Request processed in 117us (3959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463773.741997:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788463773.742016:0:23370:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9618ad76ad80 x1875339485919744/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788463789 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463773.742032:0:23370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23370:1875339485919744:0@lo:900:osp-pre-0-1.0 00000020:00000004:3.0:1788463773.901239:0:24601:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788463773.901474:0:24601:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1788463774.276813:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788463774.596158:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463774.596183:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485919872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463774.596261:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463774.596312:0:23368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485919872 00000100:00100000:1.0:1788463774.596320:0:23368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485919872 00000100:00100000:1.0:1788463774.596372:0:23368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788463774.596381:0:23368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485919872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788463774.596419:0:23368:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788463774.596473:0:23368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485919872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463774.596479:0:23368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788463774.596529:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485919872:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788463774.599932:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788463774.599955:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485920000:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463774.600027:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463774.600135:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485920000 00000100:00100000:1.0:1788463774.600143:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485920000 00000100:00100000:1.0:1788463774.600194:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788463774.600216:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad76ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485920000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788463774.600254:0:22632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788463774.600306:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad76ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485920000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463774.600313:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788463774.600443:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485920000:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788463774.725548:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463775.747725:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463776.773908:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463777.736159:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463757/real 1788463757] req@ffff96188d1d2680 x1875339485909888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463777 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463777.736203:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96188d1d2680 x1875339485909888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463777 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463777.736214:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463757/real 1788463757] req@ffff96188d1d0a80 x1875339485910016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463777 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463777.736225:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96188d1d0a80 x1875339485910016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463777 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788463777.736245:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188ced8000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788463777.736272:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788463777.736276:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485909888:0@lo:8:kworker.0 00000100:00080000:2.0:1788463777.736282:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9617873e8000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788463777.736287:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788463777.736290:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485910016:0@lo:8:kworker.0 00000100:00080000:0.0:1788463777.738104:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463777.738110:0:1365:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788463777.738113:0:1365:0:(import.c:65:import_set_state_nolock()) ffff96188ced8000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788463777.738121:0:1365:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 796 00000100:00080000:0.0:1788463777.738127:0:1365:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788463777.738133:0:1365:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96188ced8000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:0.0:1788463777.738154:0:1365:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188d1d0a80 x1875339485920384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788463777.738170:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463777.738173:0:1365:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788463777.738175:0:1365:0:(import.c:65:import_set_state_nolock()) ffff9617873e8000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788463777.738178:0:1365:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 796 00000100:00080000:0.0:1788463777.738181:0:1365:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788463777.738185:0:1365:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9617873e8000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:0.0:1788463777.738197:0:1365:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188d1d2680 x1875339485920512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788463777.738247:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463777.738251:0:1365:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788463777.738253:0:1365:0:(import.c:65:import_set_state_nolock()) ffff961882e02800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788463777.738257:0:1365:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 813 00000100:00080000:0.0:1788463777.738260:0:1365:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788463777.738270:0:1365:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff961882e02800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:0.0:1788463777.738283:0:1365:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188d1d0000 x1875339485921024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788463777.738385:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:abd83a7b-f7e3-4d68-aade-6298a66ab956:3650:1875339485920128:0@lo:400:kworker.0 00000100:00100000:2.0:1788463777.738460:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463777.738507:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485920896:0@lo:400:kworker.0 00000100:00100000:2.0:1788463777.738536:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463777.738568:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788463777.738594:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485920256:0@lo:400:kworker.0 00000100:00100000:2.0:1788463777.738641:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463777.738664:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485921152:0@lo:400:kworker.0 00000100:00100000:2.0:1788463777.738688:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463777.738718:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485920640:0@lo:400:kworker.0 00000100:00100000:2.0:1788463777.738752:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463777.738771:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485921280:0@lo:400:kworker.0 00000100:00100000:2.0:1788463777.738792:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463777.738811:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788463777.738818:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485920768:0@lo:400:kworker.0 00000100:00100000:2.0:1788463777.738840:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463777.738860:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485921408:0@lo:400:kworker.0 00000100:00100000:2.0:1788463777.738881:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463777.742315:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485920896 00000100:00100000:2.0:1788463777.742331:0:24131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485920896 00000100:00100000:2.0:1788463777.742400:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788463777.742409:0:24131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad76b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485920896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463777.742496:0:24131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad76b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485920896:12345-0@lo:400:kworker.0 Request processed in 88us (3959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463777.742502:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788463777.742523:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485920256 00000100:00100000:2.0:1788463777.742526:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485920256 00000100:00100000:2.0:1788463777.742545:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485920768 00000100:00100000:2.0:1788463777.742548:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485920768 00000100:00100000:2.0:1788463777.742559:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788463777.742563:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485920256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463777.742621:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485920256:12345-0@lo:400:kworker.0 Request processed in 57us (3989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463777.742627:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788463777.742639:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788463777.742644:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad76a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485920768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463777.742696:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad76a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485920768:12345-0@lo:400:kworker.0 Request processed in 52us (3855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463777.742702:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788463777.742720:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485921152 00000100:00100000:2.0:1788463777.742724:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485921152 00000100:00100000:2.0:1788463777.742740:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485920640 00000100:00100000:2.0:1788463777.742742:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485920640 00000100:00100000:2.0:1788463777.742752:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485921280 00000100:00100000:2.0:1788463777.742754:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485921280 00000100:00100000:2.0:1788463777.742767:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485921408 00000100:00100000:2.0:1788463777.742769:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485921408 00000100:00100000:2.0:1788463777.742783:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788463777.742788:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485921152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463777.742818:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485921152:12345-0@lo:400:kworker.0 Request processed in 30us (4129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463777.742824:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788463777.742836:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788463777.742842:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485920640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463777.742867:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485920640:12345-0@lo:400:kworker.0 Request processed in 26us (4115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463777.742872:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788463777.742883:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788463777.742889:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485921280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463777.744019:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485920128 00000100:00100000:0.0:1788463777.744030:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485920128 00000100:00100000:0.0:1788463777.744073:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788463777.744081:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:3650:x1875339485920128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463777.744140:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:3650:x1875339485920128:12345-0@lo:400:kworker.0 Request processed in 59us (5679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463777.744146:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1788463777.744178:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788463777.744183:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788463777.744186:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463777.744293:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485921280:12345-0@lo:400:kworker.0 Request processed in 1405us (5500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463777.744300:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788463777.744315:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788463777.744328:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485921408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463777.744354:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485921408:12345-0@lo:400:kworker.0 Request processed in 28us (5472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463777.744359:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788463777.744395:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485920384:0@lo:8:kworker.0 00000100:00100000:2.0:1788463777.744423:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463777.744463:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485920512:0@lo:8:kworker.0 00000100:00100000:2.0:1788463777.744480:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463777.744494:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485921024:0@lo:8:kworker.0 00000100:00100000:2.0:1788463777.744508:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463777.744532:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485920384 00000100:00100000:2.0:1788463777.744535:0:24131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485920384 00000100:00100000:2.0:1788463777.744545:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485920512 00000100:00100000:2.0:1788463777.744548:0:24131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485920512 00000100:00100000:2.0:1788463777.744553:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485921024 00000100:00100000:2.0:1788463777.744555:0:24131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485921024 00000100:00100000:2.0:1788463777.744562:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788463777.744567:0:24131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875339485920384:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788463777.744612:0:24131:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 817 last 0 00000020:00000080:2.0:1788463777.744640:0:24131:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x841acb7f42a3b437 00002000:00100000:2.0:1788463777.744654:0:24131:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9618a4d3f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788463777.744658:0:24131:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788463777.744661:0:24131:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788463777.744727:0:24131:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788463777.744752:0:24131:0:(import.c:65:import_set_state_nolock()) ffff9618a4d3f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788463777.744790:0:24131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875339485920384:12345-0@lo:8:kworker.0 Request processed in 222us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463777.744805:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788463777.744818:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788463777.744821:0:24131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875339485920512:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788463777.744833:0:24131:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788463777.744860:0:24131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875339485920512:12345-0@lo:8:kworker.0 Request processed in 37us (378us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788463777.744866:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788463777.744877:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788463777.744881:0:24131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875339485921024:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788463777.744889:0:24131:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788463777.745080:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485920768:0@lo:400:kworker.0 00010000:00080000:3.0:1788463777.745096:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d1d0380 x1875339485921408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463777.745107:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485921408:0@lo:400:kworker.0 00010000:00080000:3.0:1788463777.745119:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d1d0e00 x1875339485920640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463777.745127:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485920640:0@lo:400:kworker.0 00010000:00080000:3.0:1788463777.745137:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d1d3800 x1875339485921280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463777.745145:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485921280:0@lo:400:kworker.0 00000100:00100000:3.0:1788463777.745178:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485920256:0@lo:400:kworker.0 00010000:00080000:3.0:1788463777.745188:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d1d0700 x1875339485921152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463777.745196:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485921152:0@lo:400:kworker.0 00000100:00100000:3.0:1788463777.745206:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:abd83a7b-f7e3-4d68-aade-6298a66ab956:3650:1875339485920128:0@lo:400:kworker.0 00010000:00080000:3.0:1788463777.745221:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d1d1500 x1875339485920896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463777.745229:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485920896:0@lo:400:kworker.0 00010000:00080000:3.0:1788463777.745285:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d1d0a80 x1875339485920384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788463802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463777.745292:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788463777.745299:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788463777.745306:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788463777.745311:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788463777.745313:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188ced8000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788463777.745326:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788463777.745330:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485920384:0@lo:8:kworker.0 00000100:00080000:3.0:1788463777.745343:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9617873e8000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788463777.745346:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788463777.745349:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485920512:0@lo:8:kworker.0 00000004:00080000:3.0:1788463777.745373:0:22650:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788463777.745433:0:22650:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 817196857265ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788463777.745438:0:22650:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1788463777.749121:0:22651:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:0.0:1788463777.749154:0:22651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22651:1875339485921664:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788463777.749240:0:22651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463777.749279:0:22651:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787095c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788463777.749300:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788463777.749312:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485921536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463777.749340:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463777.749382:0:24135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485921536 00000100:00100000:0.0:1788463777.749390:0:24135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485921536 00000100:00100000:0.0:1788463777.749457:0:24135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788463777.749460:0:24131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875339485921024:12345-0@lo:8:kworker.0 Request processed in 4573us (4945us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788463777.749471:0:24135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875339485921536:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463777.749474:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788463777.749497:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485921664 00000100:00100000:2.0:1788463777.749502:0:24131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485921664 00002000:00000024:0.0:1788463777.749505:0:24135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788463777.749528:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788463777.749536:0:24131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:22651:x1875339485921664:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788463777.749560:0:24135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1875339485921536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463777.749615:0:24135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788463777.749650:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788463777.749684:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d1d1f80 x1875339485921536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463777.749704:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485921536:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788463777.750431:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961882e02800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788463777.750439:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788463777.750443:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485921024:0@lo:8:kworker.0 00000004:00080000:3.0:1788463777.754200:0:22605:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:2.0:1788463777.764847:0:24131:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1788463777.764860:0:24131:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1788463777.764867:0:24131:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00010000:00010000:1.0:1788463777.796225:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463777.798914:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463777.798927:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3b43e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.798945:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=817s v=(0 0) 00010000:00010000:3.0:1788463777.798951:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463777.798958:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3b43e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.798989:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3b43e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.799000:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3b43e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.799007:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3b43e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.799026:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788463777.801283:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463777.801295:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006903212/0x841acb7f42a3b445 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.801312:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=817s v=(0 0) 00010000:00010000:3.0:1788463777.801316:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463777.801322:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006903212/0x841acb7f42a3b445 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.801335:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006903212/0x841acb7f42a3b445 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.801345:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006903212/0x841acb7f42a3b445 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.801364:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006903212/0x841acb7f42a3b445 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.801382:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788463777.801397:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788463777.801402:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3b43e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.801410:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813600 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463777.801415:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3b43e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.801424:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3b43e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.801440:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3b43e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.801448:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3b43e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.801467:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463777.801470:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006903212/0x841acb7f42a3b445 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.801489:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813200 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463777.801492:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006903212/0x841acb7f42a3b445 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.801499:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006903212/0x841acb7f42a3b445 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.801509:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006903212/0x841acb7f42a3b445 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.801516:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006903212/0x841acb7f42a3b445 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.801529:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463777.801531:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463777.801533:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463777.802242:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463777.802249:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000361a4a0e/0x841acb7f42a3b44c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.802258:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=817s v=(0 0) 00010000:00010000:3.0:1788463777.802262:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463777.802267:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000361a4a0e/0x841acb7f42a3b44c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.802278:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000361a4a0e/0x841acb7f42a3b44c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.802292:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000361a4a0e/0x841acb7f42a3b44c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.802299:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000361a4a0e/0x841acb7f42a3b44c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.802314:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463777.802322:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463777.802326:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000361a4a0e/0x841acb7f42a3b44c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.802333:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813800 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463777.802336:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000361a4a0e/0x841acb7f42a3b44c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.802342:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000361a4a0e/0x841acb7f42a3b44c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.802354:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000361a4a0e/0x841acb7f42a3b44c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.802361:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000361a4a0e/0x841acb7f42a3b44c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.802376:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463777.802383:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463777.802386:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463777.803011:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463777.806444:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463777.806460:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3b453 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.806478:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=817s v=(0 0) 00010000:00010000:3.0:1788463777.806484:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463777.806490:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3b453 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.806505:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3b453 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.806517:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3b453 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.806525:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3b453 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.806555:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463777.806953:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463777.806962:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3b453 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.806971:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882812400 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463777.806975:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3b453 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.806986:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3b453 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.807007:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3b453 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.807016:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3b453 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.807039:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463777.807041:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463777.807042:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463777.810454:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463777.810470:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3b45a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.810487:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=817s v=(0 0) 00010000:00010000:3.0:1788463777.810492:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463777.810499:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3b45a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.810524:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3b45a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.810535:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3b45a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.810542:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3b45a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.810563:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463777.810595:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463777.810611:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3b45a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.810619:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463777.810624:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3b45a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.810634:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3b45a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.810651:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3b45a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.810658:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3b45a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.810683:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463777.810685:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463777.810687:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463777.814815:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463777.814829:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e426dbc/0x841acb7f42a3b461 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.814845:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=817s v=(0 0) 00010000:00010000:3.0:1788463777.814851:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463777.814857:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e426dbc/0x841acb7f42a3b461 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.814883:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e426dbc/0x841acb7f42a3b461 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.814901:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e426dbc/0x841acb7f42a3b461 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.814909:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e426dbc/0x841acb7f42a3b461 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.814933:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463777.815867:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463777.815894:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e426dbc/0x841acb7f42a3b461 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.815905:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882812000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463777.815911:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e426dbc/0x841acb7f42a3b461 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.815922:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e426dbc/0x841acb7f42a3b461 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.815946:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e426dbc/0x841acb7f42a3b461 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.815954:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e426dbc/0x841acb7f42a3b461 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.815980:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463777.815982:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463777.815984:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463777.818325:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463777.818337:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af0132ca/0x841acb7f42a3b468 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.818351:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=817s v=(0 0) 00010000:00010000:0.0:1788463777.818355:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463777.818360:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af0132ca/0x841acb7f42a3b468 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.818371:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af0132ca/0x841acb7f42a3b468 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.818378:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af0132ca/0x841acb7f42a3b468 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.818383:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af0132ca/0x841acb7f42a3b468 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.818395:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788463777.818886:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463777.818892:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054cb8291/0x841acb7f42a3b46f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.818900:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=817s v=(0 0) 00010000:00010000:0.0:1788463777.818903:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463777.818907:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054cb8291/0x841acb7f42a3b46f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.818927:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054cb8291/0x841acb7f42a3b46f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.818934:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054cb8291/0x841acb7f42a3b46f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.818940:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054cb8291/0x841acb7f42a3b46f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.818956:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788463777.818966:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788463777.818972:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af0132ca/0x841acb7f42a3b468 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.818978:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4400 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463777.818982:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af0132ca/0x841acb7f42a3b468 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.818996:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af0132ca/0x841acb7f42a3b468 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.819011:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af0132ca/0x841acb7f42a3b468 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.819019:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af0132ca/0x841acb7f42a3b468 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.819042:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463777.819046:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054cb8291/0x841acb7f42a3b46f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.819053:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4200 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463777.819056:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054cb8291/0x841acb7f42a3b46f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.819064:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054cb8291/0x841acb7f42a3b46f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.819073:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054cb8291/0x841acb7f42a3b46f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.819080:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054cb8291/0x841acb7f42a3b46f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.819091:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463777.819093:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463777.819095:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463777.819612:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788463777.824626:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463777.824640:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b476 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.824669:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=817s v=(0 0) 00010000:00010000:2.0:1788463777.824674:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463777.824681:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b476 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.824698:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b476 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.824709:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b476 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.824717:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b476 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.824736:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788463777.825247:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463777.825254:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039475443/0x841acb7f42a3b47d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.825266:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=817s v=(0 0) 00010000:00010000:2.0:1788463777.825269:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463777.825273:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039475443/0x841acb7f42a3b47d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.825283:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039475443/0x841acb7f42a3b47d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.825302:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039475443/0x841acb7f42a3b47d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.825310:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039475443/0x841acb7f42a3b47d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.825327:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788463777.825617:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463777.825623:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055de2542/0x841acb7f42a3b484 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.825631:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=817s v=(0 0) 00010000:00010000:2.0:1788463777.825635:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463777.825639:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055de2542/0x841acb7f42a3b484 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.825649:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055de2542/0x841acb7f42a3b484 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.825657:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055de2542/0x841acb7f42a3b484 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.825665:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055de2542/0x841acb7f42a3b484 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.825685:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788463777.825755:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788463777.825764:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b476 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.825786:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20600 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463777.825792:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b476 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.825802:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b476 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.825820:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b476 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.825828:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b476 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.825848:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788463777.825852:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039475443/0x841acb7f42a3b47d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.825858:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21a00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463777.825861:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039475443/0x841acb7f42a3b47d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.825867:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039475443/0x841acb7f42a3b47d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.825876:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039475443/0x841acb7f42a3b47d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.825890:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039475443/0x841acb7f42a3b47d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.825911:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463777.825914:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055de2542/0x841acb7f42a3b484 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.825920:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20400 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463777.825923:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055de2542/0x841acb7f42a3b484 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.825930:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055de2542/0x841acb7f42a3b484 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.825940:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055de2542/0x841acb7f42a3b484 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.825947:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055de2542/0x841acb7f42a3b484 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.825958:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463777.825960:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463777.825961:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788463777.825991:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463777.825997:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047bae007/0x841acb7f42a3b48b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.826007:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=817s v=(0 0) 00010000:00010000:2.0:1788463777.826011:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463777.826015:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047bae007/0x841acb7f42a3b48b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.826025:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047bae007/0x841acb7f42a3b48b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.826033:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047bae007/0x841acb7f42a3b48b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.826041:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047bae007/0x841acb7f42a3b48b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.826051:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463777.826065:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788463777.826074:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047bae007/0x841acb7f42a3b48b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.826084:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463777.826089:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047bae007/0x841acb7f42a3b48b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.826098:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047bae007/0x841acb7f42a3b48b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.826119:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047bae007/0x841acb7f42a3b48b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.826127:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047bae007/0x841acb7f42a3b48b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.826151:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463777.826153:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463777.826155:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788463777.826805:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463777.826813:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c6cae49/0x841acb7f42a3b492 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.826823:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=817s v=(0 0) 00010000:00010000:2.0:1788463777.826832:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463777.826837:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c6cae49/0x841acb7f42a3b492 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.826848:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c6cae49/0x841acb7f42a3b492 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.826857:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c6cae49/0x841acb7f42a3b492 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.826865:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c6cae49/0x841acb7f42a3b492 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.826885:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463777.827194:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463777.827200:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c6cae49/0x841acb7f42a3b492 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.827215:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21600 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463777.827219:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c6cae49/0x841acb7f42a3b492 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.827226:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c6cae49/0x841acb7f42a3b492 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.827239:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c6cae49/0x841acb7f42a3b492 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.827247:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c6cae49/0x841acb7f42a3b492 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.827263:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463777.827265:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463777.827267:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463777.827324:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788463777.827916:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463777.827923:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c5648b9/0x841acb7f42a3b499 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.827934:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=817s v=(0 0) 00010000:00010000:2.0:1788463777.827937:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463777.827942:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c5648b9/0x841acb7f42a3b499 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.827962:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c5648b9/0x841acb7f42a3b499 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.827972:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c5648b9/0x841acb7f42a3b499 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.827985:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c5648b9/0x841acb7f42a3b499 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.828005:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463777.828166:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463777.828172:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c5648b9/0x841acb7f42a3b499 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.828179:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21e00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463777.828183:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c5648b9/0x841acb7f42a3b499 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.828191:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c5648b9/0x841acb7f42a3b499 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.828215:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c5648b9/0x841acb7f42a3b499 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.828222:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c5648b9/0x841acb7f42a3b499 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.828239:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463777.828241:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463777.828243:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788463777.828673:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463777.828680:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be034fbf/0x841acb7f42a3b4a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.828689:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=817s v=(0 0) 00010000:00010000:2.0:1788463777.828693:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463777.828698:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be034fbf/0x841acb7f42a3b4a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.828707:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be034fbf/0x841acb7f42a3b4a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.828715:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be034fbf/0x841acb7f42a3b4a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.828722:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be034fbf/0x841acb7f42a3b4a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.828744:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463777.828800:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463777.828807:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be034fbf/0x841acb7f42a3b4a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.828815:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20200 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463777.828818:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be034fbf/0x841acb7f42a3b4a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.828839:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be034fbf/0x841acb7f42a3b4a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.828851:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be034fbf/0x841acb7f42a3b4a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.828858:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be034fbf/0x841acb7f42a3b4a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.828873:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463777.828875:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463777.828876:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788463777.829386:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463777.829393:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3b4a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.829408:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=817s v=(0 0) 00010000:00010000:2.0:1788463777.829412:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463777.829417:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3b4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.829432:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3b4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.829441:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3b4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.829448:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3b4a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.829466:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463777.829763:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463777.829769:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3b4a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.829777:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463777.829780:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3b4a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.829788:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3b4a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.829801:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3b4a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.829808:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3b4a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.829835:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463777.829837:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463777.829839:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788463777.830523:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463777.830530:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3b4ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.830539:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=817s v=(0 0) 00010000:00010000:2.0:1788463777.830543:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463777.830547:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3b4ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.830556:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3b4ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.830588:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3b4ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.830597:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3b4ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.830624:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788463777.831047:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463777.831054:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ef24de/0x841acb7f42a3b4b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.831062:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=817s v=(0 0) 00010000:00010000:2.0:1788463777.831065:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463777.831070:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ef24de/0x841acb7f42a3b4b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.831080:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ef24de/0x841acb7f42a3b4b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.831088:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ef24de/0x841acb7f42a3b4b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.831096:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ef24de/0x841acb7f42a3b4b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.831130:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788463777.831151:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788463777.831158:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3b4ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.831167:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26200 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463777.831171:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3b4ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.831181:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3b4ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.831196:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3b4ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.831217:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3b4ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788463777.833451:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463777.833466:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8530314/0x841acb7f42a3b4bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.833484:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=817s v=(0 0) 00010000:00010000:2.0:1788463777.833490:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463777.833496:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8530314/0x841acb7f42a3b4bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.833520:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8530314/0x841acb7f42a3b4bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.833531:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8530314/0x841acb7f42a3b4bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.833539:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8530314/0x841acb7f42a3b4bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.833550:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788463777.834756:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463777.834766:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d83b557a/0x841acb7f42a3b4c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.834780:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=817s v=(0 0) 00010000:00010000:2.0:1788463777.834789:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463777.834794:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d83b557a/0x841acb7f42a3b4c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.834806:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d83b557a/0x841acb7f42a3b4c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.834817:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d83b557a/0x841acb7f42a3b4c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.834824:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d83b557a/0x841acb7f42a3b4c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.834834:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788463777.837679:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00002000:00010000:0.0:1788463777.837694:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463777.837705:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054cb8291/0x841acb7f42a3b4ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.837721:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=817s v=(0 0) 00010000:00010000:0.0:1788463777.837732:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463777.837739:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054cb8291/0x841acb7f42a3b4ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.837754:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054cb8291/0x841acb7f42a3b4ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.837804:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054cb8291/0x841acb7f42a3b4ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.837813:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054cb8291/0x841acb7f42a3b4ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.837824:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788463777.837848:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788463777.837855:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8530314/0x841acb7f42a3b4bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.837867:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e27c00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463777.837871:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8530314/0x841acb7f42a3b4bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.837882:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8530314/0x841acb7f42a3b4bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.837901:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8530314/0x841acb7f42a3b4bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.837909:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8530314/0x841acb7f42a3b4bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.837928:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788463777.837932:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d83b557a/0x841acb7f42a3b4c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.837938:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e27600 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463777.837950:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d83b557a/0x841acb7f42a3b4c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.837958:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d83b557a/0x841acb7f42a3b4c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.837970:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d83b557a/0x841acb7f42a3b4c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.837978:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d83b557a/0x841acb7f42a3b4c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.837993:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463777.837996:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054cb8291/0x841acb7f42a3b4ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.838002:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4200 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463777.838006:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054cb8291/0x841acb7f42a3b4ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.838012:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054cb8291/0x841acb7f42a3b4ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.838021:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054cb8291/0x841acb7f42a3b4ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.838028:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054cb8291/0x841acb7f42a3b4ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.838051:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463777.838053:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463777.838055:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463777.838270:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463777.838273:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463777.838274:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463777.838296:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ef24de/0x841acb7f42a3b4b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.838306:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26600 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463777.838310:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ef24de/0x841acb7f42a3b4b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.838319:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ef24de/0x841acb7f42a3b4b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.838332:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ef24de/0x841acb7f42a3b4b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.838350:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ef24de/0x841acb7f42a3b4b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463777.838365:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463777.838368:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463777.838370:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788463777.848342:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463777.848357:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba42754b/0x841acb7f42a3b4d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.848374:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=817s v=(0 0) 00010000:00010000:2.0:1788463777.848379:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463777.848386:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba42754b/0x841acb7f42a3b4d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.848401:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba42754b/0x841acb7f42a3b4d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.848411:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba42754b/0x841acb7f42a3b4d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.848432:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba42754b/0x841acb7f42a3b4d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463777.848457:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463777.848692:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463777.848701:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba42754b/0x841acb7f42a3b4d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.848710:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e27800 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463777.848716:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba42754b/0x841acb7f42a3b4d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.848726:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba42754b/0x841acb7f42a3b4d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.848743:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba42754b/0x841acb7f42a3b4d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.848752:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba42754b/0x841acb7f42a3b4d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.848777:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463777.848780:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463777.848781:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463777.850369:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463777.850380:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3b4d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.850402:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=817s v=(0 0) 00010000:00010000:3.0:1788463777.850406:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463777.850414:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3b4d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.850427:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3b4d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.850436:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3b4d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.850444:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3b4d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.850514:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788463777.851065:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463777.851071:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000361a4a0e/0x841acb7f42a3b4df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.851092:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=817s v=(0 0) 00010000:00010000:3.0:1788463777.851096:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463777.851101:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000361a4a0e/0x841acb7f42a3b4df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.851111:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000361a4a0e/0x841acb7f42a3b4df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.851119:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000361a4a0e/0x841acb7f42a3b4df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.851126:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000361a4a0e/0x841acb7f42a3b4df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.851261:0:24752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788463777.851269:0:24752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3b4d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.851290:0:24752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463777.851295:0:24752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3b4d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.851304:0:24752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3b4d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.851322:0:24752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3b4d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.851330:0:24752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3b4d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.851350:0:24752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463777.851354:0:24752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000361a4a0e/0x841acb7f42a3b4df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.851361:0:24752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813800 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463777.851364:0:24752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000361a4a0e/0x841acb7f42a3b4df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.851373:0:24752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000361a4a0e/0x841acb7f42a3b4df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.851383:0:24752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000361a4a0e/0x841acb7f42a3b4df lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.851400:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463777.851403:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463777.851405:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463777.851506:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788463777.851512:0:24131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000361a4a0e/0x841acb7f42a3b4df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788463777.852441:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463777.852450:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006903212/0x841acb7f42a3b4e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.852461:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=817s v=(0 0) 00010000:00010000:3.0:1788463777.852471:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463777.852477:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006903212/0x841acb7f42a3b4e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.852488:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006903212/0x841acb7f42a3b4e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.852497:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006903212/0x841acb7f42a3b4e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.852503:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006903212/0x841acb7f42a3b4e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.852587:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463777.852595:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006903212/0x841acb7f42a3b4e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.852613:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813200 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463777.852617:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006903212/0x841acb7f42a3b4e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.852625:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006903212/0x841acb7f42a3b4e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.852637:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006903212/0x841acb7f42a3b4e6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.852646:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463777.852648:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463777.852650:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463777.852773:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788463777.852779:0:24131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006903212/0x841acb7f42a3b4e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.853359:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463777.853373:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463777.853380:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3b4ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.853391:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=817s v=(0 0) 00010000:00010000:3.0:1788463777.853395:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463777.853400:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3b4ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.853411:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3b4ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.853427:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3b4ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.853436:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3b4ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.853452:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463777.853553:0:24752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463777.853558:0:24752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3b4ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.853565:0:24752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813600 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463777.853591:0:24752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3b4ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.853611:0:24752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3b4ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.853622:0:24752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3b4ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.853627:0:24752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3b4ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.853641:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463777.853642:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463777.853644:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463777.853799:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463777.853805:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c08e155b/0x841acb7f42a3b4f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.853813:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=817s v=(0 0) 00010000:00010000:3.0:1788463777.853966:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463777.853972:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c08e155b/0x841acb7f42a3b4f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.853984:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c08e155b/0x841acb7f42a3b4f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.853993:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c08e155b/0x841acb7f42a3b4f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.854001:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c08e155b/0x841acb7f42a3b4f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.854031:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463777.854241:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463777.854247:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c08e155b/0x841acb7f42a3b4f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.854255:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813c00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463777.854258:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c08e155b/0x841acb7f42a3b4f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.854266:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c08e155b/0x841acb7f42a3b4f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.854278:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c08e155b/0x841acb7f42a3b4f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.854293:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c08e155b/0x841acb7f42a3b4f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.854308:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463777.854310:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463777.854312:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463777.854473:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463777.854479:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e426dbc/0x841acb7f42a3b4fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.854487:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=817s v=(0 0) 00010000:00010000:3.0:1788463777.854490:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463777.854493:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e426dbc/0x841acb7f42a3b4fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.854501:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e426dbc/0x841acb7f42a3b4fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.854508:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e426dbc/0x841acb7f42a3b4fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.854515:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e426dbc/0x841acb7f42a3b4fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.854530:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463777.854551:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463777.854558:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e426dbc/0x841acb7f42a3b4fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.854566:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882812000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463777.854569:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e426dbc/0x841acb7f42a3b4fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.854614:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e426dbc/0x841acb7f42a3b4fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.854626:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e426dbc/0x841acb7f42a3b4fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.854634:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e426dbc/0x841acb7f42a3b4fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.854650:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463777.854652:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463777.854653:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463777.854959:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463777.854965:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3b502 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.854973:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=817s v=(0 0) 00010000:00010000:3.0:1788463777.854980:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463777.854984:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3b502 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.854993:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3b502 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.855001:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3b502 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.855007:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3b502 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.855029:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463777.855156:0:24752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463777.855160:0:24752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3b502 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.855165:0:24752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882812400 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463777.855167:0:24752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3b502 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.855173:0:24752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3b502 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.855180:0:24752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3b502 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.855184:0:24752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3b502 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.855195:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463777.855196:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463777.855197:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463777.855531:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463777.855537:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3b509 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.855546:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=817s v=(0 0) 00010000:00010000:3.0:1788463777.855549:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463777.855553:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3b509 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.855563:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3b509 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.855629:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3b509 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.855645:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3b509 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.855660:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463777.855686:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463777.855691:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3b509 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.855698:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463777.855702:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3b509 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.855722:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3b509 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.855734:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3b509 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.855742:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3b509 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.855755:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463777.855757:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463777.855760:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463777.856167:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463777.856174:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c5648b9/0x841acb7f42a3b510 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.856181:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=817s v=(0 0) 00010000:00010000:3.0:1788463777.856184:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463777.856186:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c5648b9/0x841acb7f42a3b510 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.856193:0:24131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c5648b9/0x841acb7f42a3b510 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.856198:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c5648b9/0x841acb7f42a3b510 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.856202:0:24131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c5648b9/0x841acb7f42a3b510 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.856310:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463777.856315:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c5648b9/0x841acb7f42a3b510 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.856323:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21e00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463777.856327:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c5648b9/0x841acb7f42a3b510 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.856335:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c5648b9/0x841acb7f42a3b510 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463777.856345:0:24131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788463777.856347:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c5648b9/0x841acb7f42a3b510 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.856365:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c5648b9/0x841acb7f42a3b510 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463777.856379:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788463777.856381:0:24131:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00010000:00010000:1.0:1788463777.856381:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463777.856383:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463777.856466:0:24131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22651:x1875339485921664:12345-0@lo:5:osp-pre-0-0.0 Request processed in 106928us (107222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463777.856482:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788463777.858068:0:22651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22651:1875339485921664:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788463777.858086:0:22651:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:0.0:1788463777.858128:0:22651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22651:1875339485921792:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788463777.858176:0:22651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463777.858213:0:22651:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618991e5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788463777.859071:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485921792 00000100:00100000:1.0:1788463777.859079:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485921792 00000100:00100000:1.0:1788463777.859129:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788463777.859138:0:24134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22651:x1875339485921792:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788463777.859180:0:24134:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:2.0:1788463777.882513:0:24128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:2.0:1788463777.882559:0:24128:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788463777.882793:0:24134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22651:x1875339485921792:12345-0@lo:5:osp-pre-0-0.0 Request processed in 23651us (24612us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788463777.882813:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788463777.888770:0:22651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1788463777.888786:0:22651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22651:1875339485921792:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788463777.888805:0:22651:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000100:00100000:0.0:1788463778.692151:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485921920:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788463778.692225:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463778.692278:0:24135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485921920 00000100:00100000:0.0:1788463778.692285:0:24135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485921920 00000100:00100000:0.0:1788463778.692329:0:24135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788463778.692338:0:24135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485921920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788463778.692358:0:24135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788463778.692396:0:24135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485921920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463778.692411:0:24135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788463778.692458:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485921920:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788463778.822949:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463779.716190:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485922048:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463779.716265:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463779.716359:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485922176:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788463779.716398:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463779.716439:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485922048 00000100:00100000:2.0:1788463779.716448:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485922048 00000100:00100000:2.0:1788463779.716493:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485922176 00000100:00100000:2.0:1788463779.716496:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485922176 00000100:00100000:2.0:1788463779.716510:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788463779.716518:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485922048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788463779.716553:0:22632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788463779.716695:0:23368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788463779.716704:0:23368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485922176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788463779.716723:0:23368:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788463779.716757:0:23368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485922176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463779.716764:0:23368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788463779.716808:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485922176:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788463779.717865:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485922048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1345us (1597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463779.717874:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788463779.718014:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485922048:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788463779.851672:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788463780.551381:0:23381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788463780.868714:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463781.892023:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788463781.930961:0:24949:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788463781.930966:0:24949:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788463781.930968:0:24949:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788463781.931085:0:24949:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9618a4d38000 00000020:01000004:2.0:1788463781.931102:0:24949:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788463781.931120:0:24949:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788463781.931139:0:24949:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff96188d8019c0) 00000020:00000080:2.0:1788463781.931176:0:24949:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788463782.021505:0:24949:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788463782.024628:0:24949:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788463782.024968:0:24949:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788463782.025295:0:24949:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788463782.025466:0:24949:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788463782.026122:0:24949:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788463782.027186:0:24949:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1788463782.028540:0:24949:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788463782.028810:0:24949:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788463782.028826:0:24949:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788463782.028837:0:24949:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x841acb7f42a3b51e 00000020:01000004:3.0:1788463782.028844:0:24949:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788463782.028876:0:24949:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.153@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788463782.028881:0:24949:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788463782.028890:0:24949:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788463782.028918:0:24949:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788463782.028921:0:24949:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.153@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788463782.046493:0:24949:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.153@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788463782.046545:0:24949:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.153@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788463782.046551:0:24949:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788463782.046552:0:24949:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788463782.046554:0:24949:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463782.046555:0:24949:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463782.046556:0:24949:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463782.046558:0:24949:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463782.046559:0:24949:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788463782.046561:0:24949:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463782.046562:0:24949:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788463782.046566:0:24949:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788463782.046568:0:24949:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788463782.046569:0:24949:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788463782.046570:0:24949:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463782.046572:0:24949:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463782.046646:0:24949:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463782.046648:0:24949:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463782.046649:0:24949:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788463782.046650:0:24949:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463782.046651:0:24949:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788463782.046677:0:24949:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788463782.046697:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485922304:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788463782.046770:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463782.046956:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff961884f86780 going to sleep for 11 seconds 00000100:00100000:1.0:1788463782.047067:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485922304 00000100:00100000:1.0:1788463782.047075:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485922304 00000100:00100000:1.0:1788463782.047162:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788463782.047172:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:24949:x1875339485922304:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788463782.047201:0:22618:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788463782.047204:0:22618:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788463782.047209:0:22618:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788463782.047489:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:24949:x1875339485922304:12345-0@lo:253:mount.lustre.0 Request processed in 318us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463782.047497:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788463782.047607:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485922304:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788463782.047618:0:24949:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788463782.047620:0:24949:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788463782.047621:0:24949:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788463782.047623:0:24949:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463782.047624:0:24949:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463782.047625:0:24949:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463782.047626:0:24949:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463782.047627:0:24949:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788463782.047629:0:24949:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463782.047635:0:24949:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788463782.047659:0:24949:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9618a4d38000 from lustre-OST0001 10000000:01000000:2.0:1788463782.047686:0:24949:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788463782.047690:0:24949:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788463782.047701:0:24949:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9617887899c0 local copy 00010000:00010000:2.0:1788463782.047711:0:24949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5e00/0x841acb7f42a3b158 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b15f expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463782.047782:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485922432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463782.048019:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463782.048045:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff961884f866c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463782.048090:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485922432 00000100:00100000:1.0:1788463782.048095:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485922432 00000100:00100000:1.0:1788463782.048162:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788463782.048174:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:24949:x1875339485922432:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463782.048248:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:24949:x1875339485922432:12345-0@lo:501:mount.lustre.0 Request processed in 79us (229us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788463782.048255:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788463782.048451:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485922432:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788463782.048467:0:24949:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788463782.048531:0:24949:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788463782.048538:0:24949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5e00/0x841acb7f42a3b158 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b15f expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463782.048546:0:24949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff96188f6f5e00/0x841acb7f42a3b158 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b15f expref: -99 pid: 22604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463782.048615:0:24949:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9618a4d38000 10000000:01000000:3.0:1788463782.048620:0:24949:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788463782.048626:0:24949:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788463782.048629:0:24949:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788463782.048634:0:24949:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788463782.048637:0:24949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788463782.048658:0:24949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e21000/0x841acb7f42a3b525 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463782.048666:0:24949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961785e21000/0x841acb7f42a3b525 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463782.048674:0:24949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961785e21000/0x841acb7f42a3b525 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463782.048688:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485922560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788463782.048716:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463782.048735:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff96189163c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788463782.048797:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485922560 00000100:00100000:2.0:1788463782.048801:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485922560 00000100:00100000:2.0:1788463782.048835:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788463782.048841:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:24949:x1875339485922560:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788463782.048850:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463782.049036:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618c1e26e00/0x841acb7f42a3b52c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b525 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463782.049062:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618c1e26e00/0x841acb7f42a3b52c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b525 expref: 22 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463782.049073:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618c1e26e00/0x841acb7f42a3b52c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b525 expref: 22 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463782.049083:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e26e00, rc 0) 00000100:00100000:2.0:1788463782.049117:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+22:24949:x1875339485922560:12345-0@lo:101:mount.lustre.0 Request processed in 276us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463782.049122:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788463782.049190:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485922560:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463782.049216:0:24949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961785e21000/0x841acb7f42a3b525 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b52c expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463782.049226:0:24949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961785e21000/0x841acb7f42a3b525 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b52c expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788463782.050143:0:24949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1788463782.050708:0:24949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788463782.053002:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788463782.053053:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1788463782.053071:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1788463782.053083:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1788463782.053095:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1788463782.053105:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1788463782.053117:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1788463782.053133:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1788463782.053148:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:0.0:1788463782.053170:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:0.0:1788463782.053175:0:24949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:0.0:1788463782.053285:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485922688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463782.053358:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463782.053446:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188cf3e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788463782.053506:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485922688 00000100:00100000:2.0:1788463782.053531:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485922688 00000100:00100000:2.0:1788463782.053727:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788463782.053737:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+22:24949:x1875339485922688:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463782.054149:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+22:24949:x1875339485922688:12345-0@lo:501:mount.lustre.0 Request processed in 413us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463782.054158:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788463782.054227:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485922688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463782.054261:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485922816:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788463782.054297:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463782.054356:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188cf3e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788463782.054393:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485922816 00000100:00100000:2.0:1788463782.054397:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485922816 00000100:00100000:2.0:1788463782.054458:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788463782.054467:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+22:24949:x1875339485922816:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788463782.055250:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+22:24949:x1875339485922816:12345-0@lo:503:mount.lustre.0 Request processed in 782us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463782.055257:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788463782.055336:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485922816:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788463782.055762:0:24949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788463782.055846:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485922944:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788463782.055895:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463782.056262:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188cf3e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788463782.056317:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485922944 00000100:00100000:1.0:1788463782.056323:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485922944 00000100:00100000:1.0:1788463782.056354:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788463782.056363:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+22:24949:x1875339485922944:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788463782.056732:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+22:24949:x1875339485922944:12345-0@lo:502:mount.lustre.0 Request processed in 369us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463782.056740:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788463782.056845:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485922944:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788463782.057174:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788463782.057205:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1788463782.057219:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1788463782.057230:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1788463782.057243:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1788463782.057259:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1788463782.057274:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1788463782.057285:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1788463782.057296:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:0.0:1788463782.057319:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485923072:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788463782.057357:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463782.057389:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188cf3e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788463782.057444:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485923072 00000100:00100000:1.0:1788463782.057448:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485923072 00000100:00100000:1.0:1788463782.057470:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788463782.057477:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+22:24949:x1875339485923072:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788463782.057563:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+22:24949:x1875339485923072:12345-0@lo:502:mount.lustre.0 Request processed in 86us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463782.057570:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788463782.057678:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485923072:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788463782.057712:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:0.0:1788463782.057718:0:24949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1788463782.058565:0:24953:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788463782.058596:0:24953:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1788463782.058603:0:24953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463782.058606:0:24953:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788463782.058612:0:24953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788463782.058626:0:24953:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9618831e3380) 00000020:00000080:0.0:1788463782.058652:0:24953:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788463782.058657:0:24953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788463782.058731:0:24953:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9618a4d38000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788463782.058740:0:24953:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788463782.058753:0:24953:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x841acb7f42a3b53a 00010000:00010000:0.0:1788463782.065228:0:24953:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1788463782.065727:0:24953:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:0.0:1788463782.067300:0:24953:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1788463782.068756:0:24953:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788463782.068768:0:24953:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463782.068775:0:24953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463782.068777:0:24953:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788463782.068780:0:24953:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463782.068784:0:24953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463782.068785:0:24953:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788463782.068788:0:24953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788463782.068790:0:24953:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788463782.068792:0:24953:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463782.068794:0:24953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463782.068795:0:24953:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788463782.068798:0:24953:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463782.068800:0:24953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463782.068801:0:24953:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788463782.068804:0:24953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788463782.068839:0:24953:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463782.068842:0:24953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463782.068844:0:24953:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788463782.068847:0:24953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1788463782.072801:0:24949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788463782.073030:0:24949:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788463782.073803:0:24949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e21000/0x841acb7f42a3b525 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b52c expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463782.073829:0:24949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961785e21000/0x841acb7f42a3b525 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b52c expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463782.073839:0:24949:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9618a4d38000 from 1 10000000:01000000:3.0:1788463782.073842:0:24949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788463782.073888:0:24949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3b541 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463782.073897:0:24949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3b541 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463782.073908:0:24949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3b541 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463782.073931:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485923200:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788463782.074001:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463782.074043:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0240 going to sleep for 11 seconds 00000100:00100000:2.0:1788463782.074190:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485923200 00000100:00100000:2.0:1788463782.074198:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485923200 00000100:00100000:2.0:1788463782.074248:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788463782.074258:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+22:24949:x1875339485923200:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788463782.074272:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463782.074284:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3b548 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b541 expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463782.074305:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3b548 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b541 expref: 23 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463782.074317:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3b548 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b541 expref: 23 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463782.074326:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e26400, rc 0) 00000100:00100000:2.0:1788463782.074372:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+23:24949:x1875339485923200:12345-0@lo:101:mount.lustre.0 Request processed in 117us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463782.074378:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788463782.074567:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485923200:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463782.074610:0:24949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3b541 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b548 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463782.074621:0:24949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3b541 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b548 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788463782.077772:0:24949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1788463782.078164:0:24949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788463782.078332:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788463782.078358:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788463782.078373:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788463782.078384:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788463782.078395:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788463782.078407:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788463782.078421:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1788463782.078436:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1788463782.078448:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1788463782.078458:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1788463782.078470:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1788463782.078487:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1788463782.078493:0:24949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1788463782.080372:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485923328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463782.080454:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463782.080549:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891652480 going to sleep for 11 seconds 00000100:00100000:1.0:1788463782.081241:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485923328 00000100:00100000:1.0:1788463782.081249:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485923328 00000100:00100000:1.0:1788463782.081330:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788463782.081359:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+23:24949:x1875339485923328:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463782.081489:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+23:24949:x1875339485923328:12345-0@lo:501:mount.lustre.0 Request processed in 132us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463782.081497:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788463782.081607:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485923328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463782.081649:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485923456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788463782.081690:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463782.081870:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891652480 going to sleep for 11 seconds 00000100:00100000:2.0:1788463782.082019:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485923456 00000100:00100000:2.0:1788463782.082024:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485923456 00000100:00100000:0.0:1788463782.082163:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788463782.082171:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+23:24949:x1875339485923456:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788463782.082258:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+23:24949:x1875339485923456:12345-0@lo:503:mount.lustre.0 Request processed in 87us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463782.082266:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788463782.082329:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485923456:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788463782.082742:0:24949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788463782.082805:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485923584:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463782.082857:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463782.083297:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891652480 going to sleep for 11 seconds 00000100:00100000:1.0:1788463782.083338:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485923584 00000100:00100000:1.0:1788463782.083345:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485923584 00000100:00100000:2.0:1788463782.083387:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788463782.083397:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+23:24949:x1875339485923584:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788463782.083494:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+23:24949:x1875339485923584:12345-0@lo:502:mount.lustre.0 Request processed in 98us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463782.083501:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788463782.083607:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485923584:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788463782.083765:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788463782.083786:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788463782.083964:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788463782.083980:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788463782.083991:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788463782.084003:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788463782.084015:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788463782.084029:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1788463782.084056:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788463782.084069:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1788463782.084080:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1788463782.084103:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485923712:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463782.084137:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463782.084156:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891652480 going to sleep for 11 seconds 00000100:00100000:2.0:1788463782.084198:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485923712 00000100:00100000:2.0:1788463782.084202:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485923712 00000100:00100000:2.0:1788463782.084221:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788463782.084226:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+23:24949:x1875339485923712:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788463782.084298:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+23:24949:x1875339485923712:12345-0@lo:502:mount.lustre.0 Request processed in 71us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463782.084305:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788463782.084565:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485923712:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788463782.084627:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1788463782.084634:0:24949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788463782.085279:0:24957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463782.085288:0:24957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463782.085290:0:24957:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788463782.085297:0:24957:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9618a4d38000 00000020:00000080:3.0:1788463782.085300:0:24957:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788463782.085313:0:24957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463782.085315:0:24957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463782.085316:0:24957:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788463782.085319:0:24957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463782.085321:0:24957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463782.085322:0:24957:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788463782.085326:0:24957:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9618a4d38000 00000020:00000080:3.0:1788463782.085327:0:24957:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788463782.085383:0:24957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463782.085387:0:24957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463782.085388:0:24957:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788463782.085391:0:24957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463782.085393:0:24957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463782.085394:0:24957:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788463782.085397:0:24957:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9618a4d38000 00000020:00000080:3.0:1788463782.085399:0:24957:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788463782.085417:0:24957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463782.085421:0:24957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463782.085423:0:24957:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788463782.085425:0:24957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463782.085428:0:24957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463782.085429:0:24957:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788463782.085432:0:24957:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9618a4d38000 00000020:00000080:3.0:1788463782.085434:0:24957:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788463782.085454:0:24957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463782.085457:0:24957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463782.085458:0:24957:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788463782.085460:0:24957:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1788463782.085553:0:24949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788463782.085595:0:24949:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788463782.085612:0:24949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3b541 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b548 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463782.085635:0:24949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3b541 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b548 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463782.085684:0:24949:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788463782.085687:0:24949:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9618a4d38000 10000000:01000000:3.0:1788463782.085690:0:24949:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9618a4d38000 10000000:01000000:3.0:1788463782.085693:0:24949:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788463782.085698:0:24949:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9618a4d38000 from 1 10000000:01000000:3.0:1788463782.085701:0:24949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788463782.085727:0:24949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e20400/0x841acb7f42a3b54f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463782.085736:0:24949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961785e20400/0x841acb7f42a3b54f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463782.085747:0:24949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961785e20400/0x841acb7f42a3b54f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463782.085764:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485923840:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788463782.087958:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463782.088013:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891652e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788463782.088107:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485923840 00000100:00100000:0.0:1788463782.088117:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485923840 00000100:00100000:0.0:1788463782.088166:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788463782.088182:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+23:24949:x1875339485923840:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788463782.088199:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463782.088216:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96188f6f4600/0x841acb7f42a3b556 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b54f expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463782.088243:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96188f6f4600/0x841acb7f42a3b556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b54f expref: 24 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463782.088254:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96188f6f4600/0x841acb7f42a3b556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b54f expref: 24 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463782.088263:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f4600, rc 0) 00000100:00100000:0.0:1788463782.088326:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:24949:x1875339485923840:12345-0@lo:101:mount.lustre.0 Request processed in 146us (2519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463782.088334:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788463782.088491:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485923840:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463782.088510:0:24949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961785e20400/0x841acb7f42a3b54f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b556 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463782.088536:0:24949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961785e20400/0x841acb7f42a3b54f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b556 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788463782.093595:0:24949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1788463782.096002:0:24949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788463782.096249:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788463782.096277:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788463782.096289:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788463782.096301:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788463782.096312:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788463782.096326:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788463782.096341:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788463782.096353:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788463782.096364:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788463782.096374:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788463782.096386:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788463782.096401:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788463782.096415:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788463782.096427:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788463782.096437:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788463782.096461:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788463782.096478:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788463782.096491:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788463782.096503:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788463782.096541:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788463782.096560:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788463782.096589:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788463782.096605:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788463782.096622:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788463782.096636:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1788463782.096648:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1788463782.096659:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1788463782.096670:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1788463782.096683:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1788463782.096708:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1788463782.096721:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1788463782.096742:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1788463782.096756:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1788463782.096771:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1788463782.096785:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1788463782.096797:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1788463782.096807:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1788463782.096818:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1788463782.096832:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1788463782.096846:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1788463782.099981:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1788463782.100075:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1788463782.100090:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1788463782.100102:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1788463782.100117:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1788463782.100132:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1788463782.100151:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1788463782.100178:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1788463782.100347:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1788463782.100366:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1788463782.100380:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1788463782.100385:0:24949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1788463782.100505:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485923968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463782.100600:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463782.100633:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618916523c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463782.100733:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485923968 00000100:00100000:2.0:1788463782.100740:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485923968 00000100:00100000:2.0:1788463782.100791:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788463782.100800:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:24949:x1875339485923968:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463782.101342:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:24949:x1875339485923968:12345-0@lo:501:mount.lustre.0 Request processed in 542us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463782.101350:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788463782.101443:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485923968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463782.101476:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485924096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788463782.101513:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463782.101551:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618916523c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463782.103000:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485924096 00000100:00100000:2.0:1788463782.103011:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485924096 00000100:00100000:2.0:1788463782.103056:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788463782.103067:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:24949:x1875339485924096:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788463782.103201:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:24949:x1875339485924096:12345-0@lo:503:mount.lustre.0 Request processed in 135us (1686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463782.103217:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788463782.103357:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485924096:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788463782.105054:0:24949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788463782.105147:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485924224:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463782.105212:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463782.105298:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891652e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788463782.110396:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485924224 00000100:00100000:1.0:1788463782.110412:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485924224 00000100:00100000:1.0:1788463782.110474:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788463782.110485:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:24949:x1875339485924224:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788463782.110694:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:24949:x1875339485924224:12345-0@lo:502:mount.lustre.0 Request processed in 210us (5480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463782.110702:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788463782.110780:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485924224:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788463782.111272:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788463782.111302:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788463782.111317:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788463782.111331:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788463782.111346:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1788463782.111363:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1788463782.111379:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1788463782.111392:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1788463782.111405:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788463782.111418:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1788463782.111446:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1788463782.111461:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1788463782.111474:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788463782.111489:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788463782.111530:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788463782.111549:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788463782.111566:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788463782.111603:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788463782.111619:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788463782.111631:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788463782.111646:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788463782.111658:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788463782.111671:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788463782.111685:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788463782.111699:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1788463782.111715:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1788463782.111743:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1788463782.111759:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1788463782.111776:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1788463782.111910:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1788463782.111931:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1788463782.111945:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1788463782.111962:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1788463782.111978:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1788463782.111995:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1788463782.112010:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1788463782.112027:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1788463782.112046:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1788463782.112060:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1788463782.112075:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1788463782.112091:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1788463782.112108:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1788463782.112138:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1788463782.112158:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1788463782.112176:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1788463782.112191:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1788463782.112206:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1788463782.112232:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1788463782.112284:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485924352:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788463782.112345:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463782.112388:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188689f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463782.112398:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485924352 00000100:00100000:2.0:1788463782.112407:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485924352 00000100:00100000:2.0:1788463782.112454:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788463782.112464:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:24949:x1875339485924352:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788463782.112656:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:24949:x1875339485924352:12345-0@lo:502:mount.lustre.0 Request processed in 192us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463782.112663:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788463782.112707:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485924352:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788463782.112984:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1788463782.113008:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1788463782.113029:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485924480:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788463782.113065:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463782.113096:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188689f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463782.113407:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485924480 00000100:00100000:0.0:1788463782.113413:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485924480 00000100:00100000:0.0:1788463782.113451:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788463782.113459:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:24949:x1875339485924480:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788463782.113564:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:24949:x1875339485924480:12345-0@lo:502:mount.lustre.0 Request processed in 104us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463782.113571:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788463782.113684:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485924480:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788463782.113726:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1788463782.113734:0:24949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788463782.118998:0:24962:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788463782.119018:0:24962:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9618831e4d40) 00000020:00000080:0.0:1788463782.119042:0:24962:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1788463782.119132:0:24962:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9618a4d38000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788463782.119137:0:24962:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9618a4d38000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788463782.119140:0:24962:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9618a4d38000 3 00010000:00080000:0.0:1788463782.119176:0:24962:0:(ldlm_lib.c:102:import_set_conn()) imp ffff961788cbb800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.153@tcp at head 00010000:00010000:0.0:1788463782.121294:0:24962:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1788463782.121534:0:24962:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788463782.121603:0:24962:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788463782.121615:0:24962:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x841acb7f42a3b564 00000100:00080000:0.0:1788463782.121625:0:24962:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788463782.121631:0:24962:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff961788cbb800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:0.0:1788463782.121667:0:24962:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188d1d1500 x1875339485924608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788463782.121701:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875339485924608:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788463782.121767:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463782.121829:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485924608 00000100:00100000:0.0:1788463782.121837:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485924608 00000100:00100000:0.0:1788463782.124615:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788463782.124628:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875339485924608:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788463782.124671:0:22628:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 821 last 0 00000020:00000080:0.0:1788463782.124722:0:22628:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x841acb7f42a3b56b 00000004:00100000:0.0:1788463782.124740:0:22628:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788463782.124775:0:22628:0:(import.c:65:import_set_state_nolock()) ffff961885210800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788463782.125108:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875339485924608:12345-0@lo:38:llog_process_th.0 Request processed in 479us (3339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463782.125116:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788463782.125152:0:24962:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00010000:00080000:1.0:1788463782.125962:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d1d1500 x1875339485924608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788463792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463782.125977:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788463782.125988:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1788463782.125995:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788463782.126001:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788463782.126003:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961788cbb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788463782.126009:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875339485924608:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788463782.126084:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788463782.126088:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788463782.126090:0:8:0:(import.c:65:import_set_state_nolock()) ffff9617873e8000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788463782.126095:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 817 00000100:00080000:1.0:1788463782.126104:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788463782.126109:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9617873e8000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:1.0:1788463782.126126:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188fc20380 x1875339485924992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788463782.126165:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788463782.126168:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788463782.126170:0:8:0:(import.c:65:import_set_state_nolock()) ffff961882e02800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788463782.126173:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 817 00000100:00080000:1.0:1788463782.126176:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788463782.126179:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff961882e02800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:1.0:1788463782.126188:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188fc20000 x1875339485925504/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788463782.126231:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485925248:0@lo:400:kworker.0 00000100:00100000:1.0:1788463782.126279:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463782.126304:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485925888:0@lo:400:kworker.0 00000100:00100000:1.0:1788463782.126328:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463782.126348:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788463782.126354:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485925120:0@lo:400:kworker.0 00000100:00100000:1.0:1788463782.126386:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463782.126400:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485925760:0@lo:400:kworker.0 00000100:00100000:1.0:1788463782.126424:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463782.126448:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485925248 00000100:00100000:1.0:1788463782.126454:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485925248 00000100:00100000:1.0:1788463782.126494:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788463782.126502:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485925248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463782.126563:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485925248:12345-0@lo:400:kworker.0 Request processed in 62us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463782.126571:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788463782.126612:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485925888 00000100:00100000:1.0:1788463782.126616:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485925888 00000100:00100000:1.0:1788463782.126640:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485925120 00000100:00100000:1.0:1788463782.126642:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485925120 00000100:00100000:1.0:1788463782.126651:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485925760 00000100:00100000:1.0:1788463782.126653:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485925760 00000100:00100000:1.0:1788463782.126665:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788463782.126670:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485925888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463782.126700:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485925888:12345-0@lo:400:kworker.0 Request processed in 30us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463782.126706:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788463782.126717:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788463782.126721:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485925120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463782.126743:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485925120:12345-0@lo:400:kworker.0 Request processed in 22us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463782.126749:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788463782.126759:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788463782.126765:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485925760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463782.126789:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485925760:12345-0@lo:400:kworker.0 Request processed in 25us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463782.126794:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788463782.126812:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485924992:0@lo:8:kworker.0 00000100:00100000:1.0:1788463782.126839:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463782.126973:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485924736:0@lo:400:kworker.0 00000100:00100000:2.0:1788463782.127004:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463782.127022:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485925376:0@lo:400:kworker.0 00000100:00100000:2.0:1788463782.127040:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463782.127058:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788463782.127064:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485924864:0@lo:400:kworker.0 00000100:00100000:2.0:1788463782.127083:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463782.127096:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485925632:0@lo:400:kworker.0 00000100:00100000:2.0:1788463782.127111:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463782.127139:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485924736 00000100:00100000:2.0:1788463782.127142:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485924736 00000100:00100000:2.0:1788463782.127165:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788463782.127170:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618884f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485924736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463782.127201:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618884f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485924736:12345-0@lo:400:kworker.0 Request processed in 31us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463782.127208:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788463782.127238:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485924736:0@lo:400:kworker.0 00000100:00100000:3.0:1788463782.127331:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485924992 00000100:00100000:3.0:1788463782.127335:0:24131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485924992 00000100:00100000:3.0:1788463782.127362:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485925376 00000100:00100000:3.0:1788463782.127365:0:24131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485925376 00000100:00100000:3.0:1788463782.127381:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485924864 00000100:00100000:3.0:1788463782.127383:0:24131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485924864 00000100:00100000:3.0:1788463782.127395:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788463782.127401:0:24131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf557b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485925376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463782.127438:0:24131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf557b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485925376:12345-0@lo:400:kworker.0 Request processed in 37us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463782.127444:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788463782.127455:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788463782.127460:0:24131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485924864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463782.127482:0:24131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485924864:12345-0@lo:400:kworker.0 Request processed in 23us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463782.127487:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788463782.127498:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788463782.127502:0:24131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875339485924992:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788463782.127556:0:24131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875339485924992:12345-0@lo:8:kworker.0 Request processed in 52us (716us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788463782.127563:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788463782.127605:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485924864:0@lo:400:kworker.0 00000100:00100000:3.0:1788463782.127624:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485925376:0@lo:400:kworker.0 00000100:00100000:0.0:1788463782.128208:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485925632 00000100:00100000:0.0:1788463782.128213:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485925632 00000100:00100000:0.0:1788463782.128235:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788463782.128242:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485925632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463782.128306:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485925632:12345-0@lo:400:kworker.0 Request processed in 60us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463782.128312:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788463782.128334:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788463782.128339:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788463782.128342:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:01000004:0.0:1788463782.128457:0:24962:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000100:00100000:1.0:1788463782.128469:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485925504:0@lo:8:kworker.0 00000020:00000080:0.0:1788463782.128472:0:24962:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9618831e19c0) 00000020:00000080:0.0:1788463782.128498:0:24962:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000100:00100000:1.0:1788463782.128513:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463782.128565:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788463782.128571:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9617873e8000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788463782.128590:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788463782.128594:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485924992:0@lo:8:kworker.0 00000100:00100000:1.0:1788463782.128621:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485925504 00000100:00100000:1.0:1788463782.128624:0:24131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485925504 00000020:01000004:0.0:1788463782.128642:0:24962:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9618a4d38000 from lustre-OST0001, refs=3 00000100:00100000:1.0:1788463782.128643:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000020:01000004:0.0:1788463782.128648:0:24962:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9618a4d38000 from lustre-OST0001, refs=3 00000100:00100000:1.0:1788463782.128651:0:24131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875339485925504:12345-0@lo:8:kworker.0 00000020:01000004:0.0:1788463782.128652:0:24962:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9618a4d38000 3 00010000:00080000:0.0:1788463782.128686:0:24962:0:(ldlm_lib.c:102:import_set_conn()) imp ffff961788cbe000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.153@tcp at head 00000100:00100000:1.0:1788463782.128701:0:24131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875339485925504:12345-0@lo:8:kworker.0 Request processed in 49us (187us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788463782.128707:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788463782.128744:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188fc22680 x1875339485925120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463782.128755:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485925120:0@lo:400:kworker.0 00010000:00080000:1.0:1788463782.128766:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188fc23b80 x1875339485925760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463782.128775:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485925760:0@lo:400:kworker.0 00000100:00100000:1.0:1788463782.128798:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485925248:0@lo:400:kworker.0 00010000:00080000:1.0:1788463782.128824:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9617884d7480 x1875339485925888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463782.128832:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485925888:0@lo:400:kworker.0 00000100:00100000:1.0:1788463782.128863:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788463782.128873:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961882e02800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788463782.128877:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788463782.128880:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485925504:0@lo:8:kworker.0 00010000:00080000:3.0:1788463782.128986:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188fc21c00 x1875339485925632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463782.128997:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485925632:0@lo:400:kworker.0 00010000:00010000:0.0:1788463782.133565:0:24962:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1788463782.133791:0:24962:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788463782.133837:0:24962:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788463782.133849:0:24962:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x841acb7f42a3b579 00000100:00080000:0.0:1788463782.133858:0:24962:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788463782.134450:0:24962:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff961788cbe000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:0.0:1788463782.134487:0:24962:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188d1d3800 x1875339485926016/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788463782.135791:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875339485926016:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788463782.135877:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788463782.135939:0:24962:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788463782.136032:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485926016 00000100:00100000:1.0:1788463782.136042:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485926016 00000100:00100000:1.0:1788463782.136080:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788463782.136088:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875339485926016:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788463782.136117:0:22628:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 821 last 0 00000020:00000080:1.0:1788463782.136153:0:22628:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x841acb7f42a3b580 00000004:00100000:1.0:1788463782.136168:0:22628:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788463782.136201:0:22628:0:(import.c:65:import_set_state_nolock()) ffff961787124000 : changing import state from RECOVER to FULL 00000040:00080000:0.0:1788463782.136206:0:24962:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00100000:1.0:1788463782.136266:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875339485926016:12345-0@lo:38:llog_process_th.0 Request processed in 177us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463782.136274:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788463782.136284:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d1d3800 x1875339485926016/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788463792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:01000000:1.0:1788463782.136300:0:24949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 00000100:00100000:0.0:1788463782.136321:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788463782.136330:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 10000000:01000000:1.0:1788463782.136336:0:24949:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00080000:0.0:1788463782.136337:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788463782.136344:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788463782.136347:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961788cbe000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788463782.136353:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875339485926016:0@lo:38:llog_process_th.0 00010000:00010000:1.0:1788463782.136354:0:24949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e20400/0x841acb7f42a3b54f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b556 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463782.136367:0:24949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961785e20400/0x841acb7f42a3b54f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b556 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788463782.136417:0:24949:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788463782.136420:0:24949:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788463782.136421:0:24949:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788463782.136423:0:24949:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788463782.136424:0:24949:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788463782.136425:0:24949:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788463782.136427:0:24949:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788463782.136433:0:24949:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788463782.136434:0:24949:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788463782.136438:0:24949:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788463782.136441:0:24949:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788463782.136443:0:24949:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788463782.136444:0:24949:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788463782.136445:0:24949:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788463782.136446:0:24949:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788463782.136447:0:24949:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788463782.136449:0:24949:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788463782.136450:0:24949:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788463782.136451:0:24949:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788463782.136471:0:24949:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788463782.136484:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485926144:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788463782.136530:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463782.136552:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618991e5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463782.136608:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485926144 00000100:00100000:2.0:1788463782.136613:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485926144 00000100:00100000:2.0:1788463782.136646:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788463782.136654:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:24949:x1875339485926144:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788463782.136672:0:22620:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788463782.136684:0:22620:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788463782.145026:0:22620:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788463782.145079:0:22620:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788463782.145390:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:24949:x1875339485926144:12345-0@lo:253:mount.lustre.0 Request processed in 8731us (8853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463782.145403:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788463782.145525:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:abd83a7b-f7e3-4d68-aade-6298a66ab956:24949:1875339485926144:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788463782.145542:0:24949:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788463782.145546:0:24949:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788463782.145548:0:24949:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788463782.145550:0:24949:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788463782.145551:0:24949:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788463782.145552:0:24949:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788463782.145554:0:24949:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788463782.145556:0:24949:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788463782.145558:0:24949:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788463782.145560:0:24949:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788463782.145610:0:24949:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788463782.146297:0:22642:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788463782.146303:0:22642:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788463782.146327:0:22642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff961785e21a00/0x841acb7f42a3b587 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463782.146346:0:22642:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96188f6f4e00/0x841acb7f42a3b41b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b414 expref: 23 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463782.146354:0:22642:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961785e20e00/0x841acb7f42a3b429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b422 expref: 23 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463782.146361:0:22642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff961785e21a00/0x841acb7f42a3b587 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463782.146403:0:22642:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961785e20e00/0x841acb7f42a3b429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3b422 expref: 23 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463782.146419:0:22642:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff961785e20e00/0x841acb7f42a3b429 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3b422 expref: 23 pid: 22618 timeout: 921 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463782.146433:0:22642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d112680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22642:1875339485926272:0@lo:104: 00000100:00100000:3.0:1788463782.146482:0:22642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788463782.146545:0:22642:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96188f6f4e00/0x841acb7f42a3b41b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3b414 expref: 23 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463782.146564:0:22642:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96188f6f4e00/0x841acb7f42a3b41b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3b414 expref: 23 pid: 22618 timeout: 921 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463782.146587:0:22642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d112300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22642:1875339485926400:0@lo:104: 00000100:00100000:2.0:1788463782.146931:0:22610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485926272 00000100:00100000:2.0:1788463782.146938:0:22610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485926272 00000100:00100000:2.0:1788463782.147022:0:22610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788463782.147031:0:22642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463782.147031:0:22610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d111180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:abd83a7b-f7e3-4d68-aade-6298a66ab956+3:22642:x1875339485926272:12345-0@lo:104: 00010000:00010000:2.0:1788463782.147044:0:22610:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a3b422 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3b429 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463782.147049:0:22642:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891652480 going to sleep for 11 seconds 00010000:00010000:2.0:1788463782.147104:0:22610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788463782.147111:0:22610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d111180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:abd83a7b-f7e3-4d68-aade-6298a66ab956+3:22642:x1875339485926272:12345-0@lo:104: Request processed in 82us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463782.147118:0:22610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788463782.147132:0:22610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485926400 00000100:00100000:2.0:1788463782.147136:0:22610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485926400 00000100:00100000:2.0:1788463782.147150:0:22610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788463782.147156:0:22610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d111880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:abd83a7b-f7e3-4d68-aade-6298a66ab956+3:22642:x1875339485926400:12345-0@lo:104: 00010000:00010000:2.0:1788463782.147163:0:22610:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961785e21800/0x841acb7f42a3b414 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3b41b expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463782.147164:0:22642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d112680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22642:1875339485926272:0@lo:104: 00010000:00010000:2.0:1788463782.147231:0:22610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788463782.147237:0:22610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d111880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:abd83a7b-f7e3-4d68-aade-6298a66ab956+3:22642:x1875339485926400:12345-0@lo:104: Request processed in 81us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463782.147245:0:22610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788463782.147272:0:22642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d112300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22642:1875339485926400:0@lo:104: 00010000:00010000:3.0:1788463782.147293:0:22642:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff961785e21a00/0x841acb7f42a3b587 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1788463782.147526:0:24949:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00010000:1.0:1788463782.147945:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788463782.147953:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a3b422 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3b429 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463782.147961:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813e00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:1.0:1788463782.147965:0:22614:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a3b422 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3b429 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463782.147975:0:22614:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a3b422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3b429 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463782.147982:0:22614:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a3b422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3b429 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463782.147986:0:22614:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788463782.148197:0:22614:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a3b422 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b429 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463782.148216:0:22614:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463782.148250:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a3b422 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b429 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463782.148258:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a3b422 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b429 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463782.148272:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463782.148276:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961785e21800/0x841acb7f42a3b414 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3b41b expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463782.148282:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21800 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:1.0:1788463782.148286:0:22614:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961785e21800/0x841acb7f42a3b414 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3b41b expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463782.148292:0:22614:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961785e21800/0x841acb7f42a3b414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3b41b expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463782.148298:0:22614:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961785e21800/0x841acb7f42a3b414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3b41b expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463782.148303:0:22614:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788463782.148328:0:22614:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961785e21800/0x841acb7f42a3b414 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b41b expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463782.148335:0:22614:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463782.148342:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961785e21800/0x841acb7f42a3b414 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b41b expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463782.148349:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961785e21800/0x841acb7f42a3b414 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b41b expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463782.148370:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463782.148373:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463782.148374:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463782.148382:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463782.148394:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:abd83a7b-f7e3-4d68-aade-6298a66ab956:3651:1875339485926656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788463782.148506:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:abd83a7b-f7e3-4d68-aade-6298a66ab956:3650:1875339485926528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788463782.148559:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463782.148687:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463782.148856:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485926528 00000100:00100000:2.0:1788463782.148864:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485926528 00010000:00010000:2.0:1788463782.148888:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961785e20e00/0x841acb7f42a3b429 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3b422 expref: 24 pid: 22618 timeout: 921 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463782.148912:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485926656 00000100:00100000:2.0:1788463782.148915:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485926656 00010000:00010000:2.0:1788463782.148927:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96188f6f4e00/0x841acb7f42a3b41b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3b414 expref: 25 pid: 22618 timeout: 921 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463782.148939:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788463782.148947:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf557480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:abd83a7b-f7e3-4d68-aade-6298a66ab956+25:3650:x1875339485926528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788463782.148962:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788463782.148963:0:22613:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1788463782.148969:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961785e20e00/0x841acb7f42a3b429 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3b422 expref: 25 pid: 22618 timeout: 921 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463782.148975:0:22613:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1788463782.148985:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961785e20e00/0x841acb7f42a3b429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3b422 expref: 25 pid: 22618 timeout: 921 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463782.149002:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961785e20e00/0x841acb7f42a3b429 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3b422 expref: 25 pid: 22618 timeout: 921 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463782.149105:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463782.149151:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf557480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:3650:x1875339485926528:12345-0@lo:103:ldlm_bl.0 Request processed in 204us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463782.149159:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788463782.149175:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788463782.149182:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:abd83a7b-f7e3-4d68-aade-6298a66ab956+23:3651:x1875339485926656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788463782.149190:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463782.149194:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96188f6f4e00/0x841acb7f42a3b41b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3b414 expref: 23 pid: 22618 timeout: 921 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463782.149204:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96188f6f4e00/0x841acb7f42a3b41b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3b414 expref: 23 pid: 22618 timeout: 921 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463782.149214:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96188f6f4e00/0x841acb7f42a3b41b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3b414 expref: 23 pid: 22618 timeout: 921 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463782.149225:0:22612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff961785e21a00/0x841acb7f42a3b587 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463782.149234:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961785e21a00/0x841acb7f42a3b587 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788463782.149245:0:22612:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014293953s 00010000:00010000:2.0:1788463782.149250:0:22612:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961785e21a00/0x841acb7f42a3b587 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463782.149257:0:22612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961785e21a00/0x841acb7f42a3b587 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463782.149273:0:22612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff961785e21a00/0x841acb7f42a3b587 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463782.149279:0:22612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff961785e21a00/0x841acb7f42a3b587 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463782.149285:0:22612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21a00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:2.0:1788463782.149290:0:22612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff961785e21a00/0x841acb7f42a3b587 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463782.149299:0:22612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff961785e21a00/0x841acb7f42a3b587 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463782.149323:0:22612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff961785e21a00/0x841acb7f42a3b587 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463782.149334:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463782.149364:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:abd83a7b-f7e3-4d68-aade-6298a66ab956+22:3651:x1875339485926656:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463782.149370:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788463782.149465:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:abd83a7b-f7e3-4d68-aade-6298a66ab956:3651:1875339485926656:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788463782.149505:0:22642:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff961785e21a00/0x841acb7f42a3b587 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463782.149525:0:22642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff961785e21a00/0x841acb7f42a3b587 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463782.149532:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961785e21a00/0x841acb7f42a3b587 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463782.151063:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:abd83a7b-f7e3-4d68-aade-6298a66ab956:3650:1875339485926528:0@lo:103:ldlm_bl.0 00002000:00080000:2.0:1788463782.153142:0:24949:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788463782.153151:0:24949:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788463782.153192:0:24949:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788463782.153239:0:24949:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.153@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788463782.153262:0:24949:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788463782.153292:0:24949:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788463782.155622:0:24949:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788463782.155873:0:24949:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788463782.790947:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463782.790978:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485926784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463782.791095:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463782.791388:0:24135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485926784 00000100:00100000:0.0:1788463782.791418:0:24135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485926784 00000100:00100000:0.0:1788463782.791490:0:24135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788463782.791512:0:24135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485926784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788463782.791556:0:24135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788463782.791664:0:24135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485926784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463782.791673:0:24135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788463782.791975:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485926784:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788463782.916840:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788463783.300865:0:22623:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788463783.300886:0:22623:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff961787d22000 from 14 10000000:01000000:1.0:1788463783.300894:0:22623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788463783.300958:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bde000/0x841acb7f42a3b58e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463783.300971:0:22623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961786bde000/0x841acb7f42a3b58e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463783.300985:0:22623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961786bde000/0x841acb7f42a3b58e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463783.301017:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485926912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788463783.301111:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463783.301176:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618991e5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788463783.301295:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485926912 00000100:00100000:0.0:1788463783.301306:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485926912 00000100:00100000:0.0:1788463783.301386:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788463783.301398:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+22:22623:x1875339485926912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463783.301415:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463783.301432:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96188f6f5c00/0x841acb7f42a3b595 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b58e expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463783.301460:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96188f6f5c00/0x841acb7f42a3b595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b58e expref: 23 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463783.301472:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96188f6f5c00/0x841acb7f42a3b595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b58e expref: 23 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463783.301483:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f5c00, rc 0) 00000100:00100000:0.0:1788463783.301562:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+23:22623:x1875339485926912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463783.301569:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788463783.302215:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485926912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463783.302239:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961786bde000/0x841acb7f42a3b58e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b595 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463783.302251:0:22623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961786bde000/0x841acb7f42a3b58e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b595 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463783.302348:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485927040:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788463783.302395:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463783.302432:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618991e5240 going to sleep for 11 seconds 00000100:00100000:2.0:1788463783.302569:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485927040 00000100:00100000:2.0:1788463783.302606:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485927040 00000100:00100000:2.0:1788463783.302657:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788463783.302667:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+23:22623:x1875339485927040:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788463783.302690:0:22620:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788463783.302723:0:22620:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788463783.302727:0:22620:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1788463783.302854:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+23:22623:x1875339485927040:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 189us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463783.302862:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788463783.303303:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485927040:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788463783.303389:0:22623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788463783.303399:0:22623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bde000/0x841acb7f42a3b58e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b595 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463783.303409:0:22623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961786bde000/0x841acb7f42a3b58e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b595 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463783.303422:0:22623:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788463783.303424:0:22623:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9618bf5d9000 from 14 10000000:01000000:1.0:1788463783.303428:0:22623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788463783.303461:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdee00/0x841acb7f42a3b59c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463783.303470:0:22623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961786bdee00/0x841acb7f42a3b59c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463783.303479:0:22623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961786bdee00/0x841acb7f42a3b59c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463783.303508:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485927168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788463783.303546:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463783.303602:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618991e5240 going to sleep for 11 seconds 00000100:00100000:1.0:1788463783.303618:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485927168 00000100:00100000:1.0:1788463783.303632:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485927168 00000100:00100000:1.0:1788463783.303667:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788463783.303676:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+23:22623:x1875339485927168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463783.303687:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463783.303701:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961786bde200/0x841acb7f42a3b5a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b59c expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463783.303828:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961786bde200/0x841acb7f42a3b5a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b59c expref: 24 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463783.303842:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961786bde200/0x841acb7f42a3b5a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b59c expref: 24 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463783.303852:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bde200, rc 0) 00000100:00100000:1.0:1788463783.303951:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:22623:x1875339485927168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 276us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463783.303959:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788463783.303999:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485927168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463783.304012:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961786bdee00/0x841acb7f42a3b59c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b5a3 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463783.304022:0:22623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961786bdee00/0x841acb7f42a3b59c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b5a3 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463783.304065:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485927296:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788463783.304099:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463783.304113:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618991e5240 going to sleep for 11 seconds 00000100:00100000:1.0:1788463783.304125:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485927296 00000100:00100000:1.0:1788463783.304136:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485927296 00000100:00100000:1.0:1788463783.304160:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788463783.304167:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:22623:x1875339485927296:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788463783.304178:0:22621:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788463783.304192:0:22621:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788463783.304195:0:22621:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1788463783.304260:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:22623:x1875339485927296:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 93us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463783.304267:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788463783.304294:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485927296:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788463783.305027:0:22623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788463783.305038:0:22623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdee00/0x841acb7f42a3b59c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b5a3 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463783.305048:0:22623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961786bdee00/0x841acb7f42a3b59c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b5a3 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:1.0:1788463783.722661:0:25016:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788463783.722907:0:25016:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788463783.820358:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485927424:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463783.820464:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463783.821052:0:24135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485927424 00000100:00100000:2.0:1788463783.821064:0:24135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485927424 00000100:00100000:2.0:1788463783.821168:0:24135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788463783.821180:0:24135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d112680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485927424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788463783.821213:0:24135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788463783.821284:0:24135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d112680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485927424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463783.821292:0:24135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788463783.822150:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485927424:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788463783.953226:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788463784.516395:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788463784.838120:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788463784.838152:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485927552:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463784.842788:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463784.842880:0:23368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485927552 00000100:00100000:1.0:1788463784.842891:0:23368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485927552 00000100:00100000:1.0:1788463784.842949:0:23368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788463784.842961:0:23368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485927552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788463784.843016:0:23368:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788463784.843068:0:23368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485927552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463784.843076:0:23368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788463784.843130:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485927552:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788463784.844507:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463784.844528:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d113b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485927680:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788463784.844610:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463784.844659:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485927680 00000100:00100000:3.0:1788463784.844667:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485927680 00000100:00100000:3.0:1788463784.844722:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788463784.844731:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d110380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485927680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788463784.844762:0:22631:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788463784.844813:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d110380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485927680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463784.844820:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788463784.844862:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d113b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485927680:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788463784.974880:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463785.995262:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.016794:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788463787.395755:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463787.395776:0:1365:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788463787.395780:0:1365:0:(import.c:65:import_set_state_nolock()) ffff9617873e8000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788463787.395792:0:1365:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9617873e8000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:0.0:1788463787.395814:0:1365:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188d1d1500 x1875339485928192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788463787.395850:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463787.395853:0:1365:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788463787.395854:0:1365:0:(import.c:65:import_set_state_nolock()) ffff961882e02800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788463787.395859:0:1365:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff961882e02800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:0.0:1788463787.395868:0:1365:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188fa1a300 x1875339485928704/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788463787.395919:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485927936:0@lo:400:kworker.0 00000100:00100000:0.0:1788463787.395988:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463787.396036:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485928576:0@lo:400:kworker.0 00000100:00100000:0.0:1788463787.396061:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463787.396079:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485929216:0@lo:400:kworker.0 00000100:00100000:0.0:1788463787.396117:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463787.396142:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788463787.396149:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:abd83a7b-f7e3-4d68-aade-6298a66ab956:3649:1875339485927808:0@lo:400:kworker.0 00000100:00100000:0.0:1788463787.396178:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463787.396201:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485928448:0@lo:400:kworker.0 00000100:00100000:0.0:1788463787.396221:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463787.396239:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485929088:0@lo:400:kworker.0 00000100:00100000:0.0:1788463787.396272:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463787.396307:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485928064:0@lo:400:kworker.0 00000100:00100000:0.0:1788463787.396331:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463787.396348:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485928832:0@lo:400:kworker.0 00000100:00100000:0.0:1788463787.396367:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463787.396385:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485929344:0@lo:400:kworker.0 00000100:00100000:0.0:1788463787.396403:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463787.396426:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788463787.396431:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485928320:0@lo:400:kworker.0 00000100:00100000:0.0:1788463787.396451:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463787.396461:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485928960:0@lo:400:kworker.0 00000100:00100000:0.0:1788463787.396481:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463787.396504:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485928192:0@lo:8:kworker.0 00000100:00100000:0.0:1788463787.396527:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463787.396541:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485928704:0@lo:8:kworker.0 00000100:00100000:0.0:1788463787.396564:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463787.396618:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485927936 00000100:00100000:0.0:1788463787.396627:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485927936 00000100:00100000:0.0:1788463787.396665:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485928448 00000100:00100000:0.0:1788463787.396668:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485928448 00000100:00100000:0.0:1788463787.396684:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788463787.396692:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485927936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463787.396742:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485927936:12345-0@lo:400:kworker.0 Request processed in 50us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463787.396750:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788463787.396767:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788463787.396774:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485928448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463787.396808:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485928448:12345-0@lo:400:kworker.0 Request processed in 34us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463787.396815:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788463787.396833:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485928576 00000100:00100000:0.0:1788463787.396837:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485928576 00000100:00100000:0.0:1788463787.396863:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485928064 00000100:00100000:0.0:1788463787.396866:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485928064 00000100:00100000:0.0:1788463787.396876:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485928192 00000100:00100000:0.0:1788463787.396879:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485928192 00000100:00100000:0.0:1788463787.396886:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485928704 00000100:00100000:0.0:1788463787.396887:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485928704 00000100:00100000:0.0:1788463787.396895:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788463787.396901:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485928576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463787.396930:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485928576:12345-0@lo:400:kworker.0 Request processed in 30us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463787.396936:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788463787.396947:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788463787.396953:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485928064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463787.396982:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485928064:12345-0@lo:400:kworker.0 Request processed in 29us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463787.396988:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788463787.396998:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788463787.397002:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1875339485928192:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788463787.397026:0:24133:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 826 last 0 00000020:00000080:0.0:1788463787.397054:0:24133:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x841acb7f42a3b5aa 00002000:00100000:0.0:1788463787.397068:0:24133:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff961788cb9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788463787.397073:0:24133:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788463787.397082:0:24133:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788463787.397272:0:24133:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788463787.397295:0:24133:0:(import.c:65:import_set_state_nolock()) ffff961788cbb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788463787.397333:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875339485928192:12345-0@lo:8:kworker.0 Request processed in 329us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463787.397339:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788463787.397352:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788463787.397356:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1875339485928704:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788463787.397372:0:24133:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 826 last 0 00000020:00000080:0.0:1788463787.397387:0:24133:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x841acb7f42a3b5b1 00002000:00100000:0.0:1788463787.397411:0:24133:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff961788cbf800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788463787.397423:0:24133:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1788463787.397425:0:24133:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788463787.397450:0:24133:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788463787.397462:0:24133:0:(import.c:65:import_set_state_nolock()) ffff961788cba800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788463787.397489:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1875339485928704:12345-0@lo:8:kworker.0 Request processed in 131us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463787.397496:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788463787.397530:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485929216 00000100:00100000:0.0:1788463787.397534:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485929216 00000100:00100000:0.0:1788463787.397555:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485929088 00000100:00100000:0.0:1788463787.397558:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485929088 00000100:00100000:0.0:1788463787.397568:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485928832 00000100:00100000:0.0:1788463787.397570:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485928832 00000100:00100000:0.0:1788463787.397606:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485929344 00000100:00100000:0.0:1788463787.397609:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485929344 00000100:00100000:0.0:1788463787.397619:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485928320 00000100:00100000:0.0:1788463787.397621:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485928320 00000100:00100000:0.0:1788463787.397630:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485928960 00000100:00100000:0.0:1788463787.397639:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485928960 00000100:00100000:0.0:1788463787.397657:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788463787.397663:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485929216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463787.397706:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485929216:12345-0@lo:400:kworker.0 Request processed in 43us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463787.397713:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788463787.397725:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788463787.397731:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485929088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463787.397755:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485929088:12345-0@lo:400:kworker.0 Request processed in 26us (1483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463787.397761:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788463787.397772:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788463787.397778:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485928832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463787.397802:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485928832:12345-0@lo:400:kworker.0 Request processed in 25us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463787.397808:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788463787.397819:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788463787.397825:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485929344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463787.397850:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485929344:12345-0@lo:400:kworker.0 Request processed in 26us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463787.397856:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788463787.397867:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788463787.397871:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485928320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463787.397894:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485928320:12345-0@lo:400:kworker.0 Request processed in 23us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463787.397909:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788463787.397921:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788463787.397927:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485928960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463787.397954:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485928960:12345-0@lo:400:kworker.0 Request processed in 29us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463787.397960:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788463787.397979:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485927808 00000100:00100000:0.0:1788463787.397983:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485927808 00000100:00100000:0.0:1788463787.398006:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788463787.398012:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e69bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:3649:x1875339485927808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463787.398038:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e69bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:3649:x1875339485927808:12345-0@lo:400:kworker.0 Request processed in 26us (1859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463787.398043:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1788463787.398086:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788463787.398090:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788463787.398092:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788463787.398121:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188d1d1500 x1875339485928192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788463812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788463787.398137:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788463787.398144:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788463787.398149:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788463787.398152:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9617873e8000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788463787.398162:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788463787.398167:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485928192:0@lo:8:kworker.0 00010000:00080000:0.0:1788463787.398180:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fa1a300 x1875339485928704/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788463812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788463787.398201:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788463787.398206:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788463787.398209:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788463787.398211:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961882e02800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788463787.398224:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788463787.398228:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485928704:0@lo:8:kworker.0 00010000:00080000:0.0:1788463787.398263:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188d1d0000 x1875339485928320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463787.398272:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485928320:0@lo:400:kworker.0 00010000:00080000:0.0:1788463787.398282:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fa1a680 x1875339485928960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463787.398290:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485928960:0@lo:400:kworker.0 00000100:00100000:0.0:1788463787.398301:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485928064:0@lo:400:kworker.0 00010000:00080000:0.0:1788463787.398310:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fa1b800 x1875339485928832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463787.398318:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485928832:0@lo:400:kworker.0 00010000:00080000:0.0:1788463787.398327:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fa18380 x1875339485929344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463787.398335:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485929344:0@lo:400:kworker.0 00000100:00100000:0.0:1788463787.398366:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:abd83a7b-f7e3-4d68-aade-6298a66ab956:3649:1875339485927808:0@lo:400:kworker.0 00000100:00100000:0.0:1788463787.398376:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485928448:0@lo:400:kworker.0 00010000:00080000:0.0:1788463787.398396:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fa18000 x1875339485929088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463787.398403:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485929088:0@lo:400:kworker.0 00000100:00100000:0.0:1788463787.398424:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485927936:0@lo:400:kworker.0 00000100:00100000:0.0:1788463787.398436:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485928576:0@lo:400:kworker.0 00010000:00080000:0.0:1788463787.398445:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fa19c00 x1875339485929216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463787.398453:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485929216:0@lo:400:kworker.0 00000004:00080000:1.0:1788463787.398745:0:22653:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1788463787.398766:0:22653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22653:1875339485929600:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788463787.398800:0:22653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463787.398822:0:22653:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618a0baf840 going to sleep for 11 seconds 00000004:00080000:1.0:1788463787.398839:0:22652:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788463787.398909:0:22652:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 826850333551ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788463787.398915:0:22652:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788463787.398987:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463787.398996:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485929472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463787.399022:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463787.399055:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485929472 00000100:00100000:1.0:1788463787.399059:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485929472 00000100:00100000:1.0:1788463787.399094:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788463787.399115:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875339485929472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788463787.399136:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788463787.399174:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875339485929472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463787.399180:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788463787.399198:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788463787.399217:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9617884d5180 x1875339485929472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463787.399244:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485929472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463787.399264:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485929600 00000100:00100000:1.0:1788463787.399267:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485929600 00000100:00100000:1.0:1788463787.399290:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788463787.399297:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22653:x1875339485929600:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788463787.400250:0:23372:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788463787.400272:0:23372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf555500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23372:1875339485929856:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1788463787.400315:0:23372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463787.400336:0:23372:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f9f6180 going to sleep for 11 seconds 00000004:00080000:2.0:1788463787.400350:0:23371:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788463787.400410:0:23371:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 826851834626ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788463787.400427:0:23371:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788463787.401301:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485929728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463787.401343:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463787.402923:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485929728 00000100:00100000:1.0:1788463787.402936:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485929728 00000100:00100000:1.0:1788463787.402991:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788463787.403000:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d113b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875339485929728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788463787.403027:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788463787.403090:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d113b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875339485929728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (1746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463787.403111:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788463787.403154:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618bf557100 x1875339485929728/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463787.403175:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485929728:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788463787.403202:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788463787.404586:0:22605:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1788463787.410495:0:24133:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788463787.410509:0:24133:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:3.0:1788463787.410516:0:24133:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:65) 00000100:00100000:0.0:1788463787.412428:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485929856 00000100:00100000:0.0:1788463787.412441:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485929856 00000100:00100000:0.0:1788463787.412490:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788463787.412499:0:24134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf554a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23372:x1875339485929856:12345-0@lo:7:osp-pre-1-1.0 00002000:00080000:1.0:1788463787.418015:0:24134:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788463787.418026:0:24134:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788463787.418129:0:24134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf554a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23372:x1875339485929856:12345-0@lo:7:osp-pre-1-1.0 Request processed in 5627us (17809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463787.418142:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788463787.418343:0:23372:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618bf555500 x1875339485929856/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788463803 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463787.418358:0:23372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf555500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23372:1875339485929856:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788463787.418374:0:23372:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788463787.418424:0:23372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23372:1875339485929984:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788463787.418458:0:23372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463787.418488:0:23372:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618991e5840 going to sleep for 11 seconds 00000100:00100000:1.0:1788463787.422691:0:24581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485929984 00000100:00100000:1.0:1788463787.422711:0:24581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485929984 00000100:00100000:1.0:1788463787.422763:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788463787.422773:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23372:x1875339485929984:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788463787.422813:0:24581:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1788463787.422885:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23372:x1875339485929984:12345-0@lo:5:osp-pre-1-1.0 Request processed in 114us (4425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463787.422892:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788463787.422938:0:23372:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178727e680 x1875339485929984/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788463803 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463787.422952:0:23372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23372:1875339485929984:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788463787.422966:0:23372:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788463787.423009:0:23372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23372:1875339485930112:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788463787.423041:0:23372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463787.423062:0:23372:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c66d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788463787.423075:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485930112 00000100:00100000:1.0:1788463787.423078:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485930112 00000100:00100000:1.0:1788463787.423111:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788463787.423118:0:24134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23372:x1875339485930112:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788463787.423142:0:24134:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000004:00080000:2.0:1788463787.426880:0:23360:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:2.0:1788463787.430799:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463787.430819:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8530314/0x841acb7f42a3b5b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.430836:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=826s v=(0 0) 00010000:00010000:2.0:1788463787.430841:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463787.430847:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8530314/0x841acb7f42a3b5b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.430865:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8530314/0x841acb7f42a3b5b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.430876:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8530314/0x841acb7f42a3b5b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.430885:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8530314/0x841acb7f42a3b5b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.430905:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788463787.433180:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788463787.433191:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067643c40/0x841acb7f42a3b5bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.433207:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=826s v=(0 0) 00010000:00010000:1.0:1788463787.433211:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463787.433218:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067643c40/0x841acb7f42a3b5bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.433234:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067643c40/0x841acb7f42a3b5bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.433251:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067643c40/0x841acb7f42a3b5bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.433258:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067643c40/0x841acb7f42a3b5bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.433284:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788463787.433519:0:24752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788463787.433528:0:24752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8530314/0x841acb7f42a3b5b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.433536:0:24752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e27c00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:2.0:1788463787.433541:0:24752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8530314/0x841acb7f42a3b5b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.433550:0:24752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8530314/0x841acb7f42a3b5b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.433595:0:24752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8530314/0x841acb7f42a3b5b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.433605:0:24752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8530314/0x841acb7f42a3b5b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.433625:0:24752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463787.433629:0:24752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067643c40/0x841acb7f42a3b5bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.433634:0:24752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf800 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:2.0:1788463787.433637:0:24752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067643c40/0x841acb7f42a3b5bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.433643:0:24752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067643c40/0x841acb7f42a3b5bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.433651:0:24752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067643c40/0x841acb7f42a3b5bf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.433657:0:24752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067643c40/0x841acb7f42a3b5bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.433670:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463787.433672:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463787.433679:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788463787.434598:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788463787.434605:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6fc74a5/0x841acb7f42a3b5c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.434618:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=826s v=(0 0) 00010000:00010000:1.0:1788463787.434621:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463787.434627:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6fc74a5/0x841acb7f42a3b5c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.434638:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6fc74a5/0x841acb7f42a3b5c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.434646:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6fc74a5/0x841acb7f42a3b5c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.434653:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6fc74a5/0x841acb7f42a3b5c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.434683:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463787.435015:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463787.435024:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6fc74a5/0x841acb7f42a3b5c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.435031:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdfe00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463787.435036:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6fc74a5/0x841acb7f42a3b5c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.435044:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6fc74a5/0x841acb7f42a3b5c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.435062:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6fc74a5/0x841acb7f42a3b5c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.435939:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463787.436200:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6fc74a5/0x841acb7f42a3b5c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.436223:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463787.436225:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463787.436227:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788463787.446891:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463787.446903:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d83b557a/0x841acb7f42a3b5cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.446918:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=826s v=(0 0) 00010000:00010000:2.0:1788463787.446924:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463787.446932:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d83b557a/0x841acb7f42a3b5cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.446947:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d83b557a/0x841acb7f42a3b5cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.446958:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d83b557a/0x841acb7f42a3b5cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.446966:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d83b557a/0x841acb7f42a3b5cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.446993:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463787.447335:0:24752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463787.447342:0:24752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d83b557a/0x841acb7f42a3b5cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.447352:0:24752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e27600 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463787.447357:0:24752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d83b557a/0x841acb7f42a3b5cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.447367:0:24752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d83b557a/0x841acb7f42a3b5cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.447383:0:24752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d83b557a/0x841acb7f42a3b5cd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.447391:0:24752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d83b557a/0x841acb7f42a3b5cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.447409:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463787.447421:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463787.447424:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788463787.448385:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463787.448395:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087ef24de/0x841acb7f42a3b5d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.448407:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=826s v=(0 0) 00010000:00010000:2.0:1788463787.448421:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463787.448427:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087ef24de/0x841acb7f42a3b5d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.448446:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087ef24de/0x841acb7f42a3b5d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.448456:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087ef24de/0x841acb7f42a3b5d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.448463:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087ef24de/0x841acb7f42a3b5d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.448486:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463787.448935:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463787.448942:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087ef24de/0x841acb7f42a3b5d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.448949:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26600 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463787.448955:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087ef24de/0x841acb7f42a3b5d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.448963:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087ef24de/0x841acb7f42a3b5d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.448978:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087ef24de/0x841acb7f42a3b5d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.448985:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087ef24de/0x841acb7f42a3b5d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.448997:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463787.448999:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463787.449000:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788463787.449910:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463787.449917:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2318edb/0x841acb7f42a3b5db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.449928:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=826s v=(0 0) 00010000:00010000:2.0:1788463787.449932:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463787.449937:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2318edb/0x841acb7f42a3b5db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.449948:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2318edb/0x841acb7f42a3b5db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.449958:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2318edb/0x841acb7f42a3b5db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.450263:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2318edb/0x841acb7f42a3b5db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.450280:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463787.450826:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463787.450833:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2318edb/0x841acb7f42a3b5db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.450841:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26a00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463787.450845:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2318edb/0x841acb7f42a3b5db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.450854:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2318edb/0x841acb7f42a3b5db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.450869:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2318edb/0x841acb7f42a3b5db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.450877:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2318edb/0x841acb7f42a3b5db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.450894:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463787.450896:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463787.450898:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788463787.450987:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463787.450993:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba42754b/0x841acb7f42a3b5e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.451002:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=826s v=(0 0) 00010000:00010000:2.0:1788463787.451005:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463787.451009:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba42754b/0x841acb7f42a3b5e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.451019:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba42754b/0x841acb7f42a3b5e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.451027:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba42754b/0x841acb7f42a3b5e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.451034:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba42754b/0x841acb7f42a3b5e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.451050:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463787.451198:0:24752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463787.451204:0:24752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba42754b/0x841acb7f42a3b5e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.451211:0:24752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e27800 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463787.451220:0:24752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba42754b/0x841acb7f42a3b5e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.451229:0:24752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba42754b/0x841acb7f42a3b5e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.451240:0:24752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba42754b/0x841acb7f42a3b5e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.451247:0:24752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba42754b/0x841acb7f42a3b5e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.451260:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463787.451262:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463787.451263:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788463787.452012:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463787.452019:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de7c7c3c/0x841acb7f42a3b5e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.452035:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=826s v=(0 0) 00010000:00010000:2.0:1788463787.452039:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463787.452043:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de7c7c3c/0x841acb7f42a3b5e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.452054:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de7c7c3c/0x841acb7f42a3b5e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.452063:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de7c7c3c/0x841acb7f42a3b5e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.452070:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de7c7c3c/0x841acb7f42a3b5e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.453199:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463787.453393:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463787.453401:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de7c7c3c/0x841acb7f42a3b5e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.453423:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463787.453428:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de7c7c3c/0x841acb7f42a3b5e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.453438:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de7c7c3c/0x841acb7f42a3b5e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.453456:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de7c7c3c/0x841acb7f42a3b5e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.453471:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de7c7c3c/0x841acb7f42a3b5e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.453491:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463787.453493:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463787.453495:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788463787.454514:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463787.454524:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001a20bf4/0x841acb7f42a3b5f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.454536:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=826s v=(0 0) 00010000:00010000:2.0:1788463787.454541:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463787.454547:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001a20bf4/0x841acb7f42a3b5f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.454560:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001a20bf4/0x841acb7f42a3b5f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.454598:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001a20bf4/0x841acb7f42a3b5f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.454607:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001a20bf4/0x841acb7f42a3b5f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.454623:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788463787.454633:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463787.454638:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001a20bf4/0x841acb7f42a3b5f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.454645:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e27200 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:2.0:1788463787.454650:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001a20bf4/0x841acb7f42a3b5f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.454658:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001a20bf4/0x841acb7f42a3b5f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.454671:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001a20bf4/0x841acb7f42a3b5f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.454677:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001a20bf4/0x841acb7f42a3b5f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463787.454691:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463787.454697:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463787.454710:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463787.456911:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463787.456924:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b5f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.456940:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=826s v=(0 0) 00010000:00010000:3.0:1788463787.456945:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463787.456950:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b5f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.456977:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b5f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.456988:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b5f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.456997:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b5f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.457013:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463787.457356:0:24752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463787.457363:0:24752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b5f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.457382:0:24752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20600 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463787.457387:0:24752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b5f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.457396:0:24752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b5f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.457426:0:24752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b5f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.457434:0:24752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b5f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.457455:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.457456:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.457458:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463787.458014:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463787.458020:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039475443/0x841acb7f42a3b5fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.458029:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=826s v=(0 0) 00010000:00010000:3.0:1788463787.458032:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463787.458037:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039475443/0x841acb7f42a3b5fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.458047:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039475443/0x841acb7f42a3b5fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.458055:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039475443/0x841acb7f42a3b5fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.458073:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039475443/0x841acb7f42a3b5fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.458101:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788463787.458443:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463787.458448:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3d8e441/0x841acb7f42a3b605 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.458458:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=826s v=(0 0) 00010000:00010000:3.0:1788463787.458461:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463787.458465:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3d8e441/0x841acb7f42a3b605 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.458476:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3d8e441/0x841acb7f42a3b605 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.458482:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3d8e441/0x841acb7f42a3b605 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.458489:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3d8e441/0x841acb7f42a3b605 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.458504:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788463787.458844:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788463787.458850:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039475443/0x841acb7f42a3b5fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.458859:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21a00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463787.458863:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039475443/0x841acb7f42a3b5fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.458873:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039475443/0x841acb7f42a3b5fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.458894:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039475443/0x841acb7f42a3b5fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.458901:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039475443/0x841acb7f42a3b5fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.458917:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463787.458921:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3d8e441/0x841acb7f42a3b605 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.458927:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20e00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463787.458930:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3d8e441/0x841acb7f42a3b605 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.458937:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3d8e441/0x841acb7f42a3b605 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.458947:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3d8e441/0x841acb7f42a3b605 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.458954:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3d8e441/0x841acb7f42a3b605 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.458963:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.458965:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.458971:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463787.459134:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463787.459140:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0bf8f9b/0x841acb7f42a3b60c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.459154:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=826s v=(0 0) 00010000:00010000:3.0:1788463787.459158:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463787.459162:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0bf8f9b/0x841acb7f42a3b60c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.459172:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0bf8f9b/0x841acb7f42a3b60c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.459181:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0bf8f9b/0x841acb7f42a3b60c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.459188:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0bf8f9b/0x841acb7f42a3b60c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.459203:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463787.459546:0:24752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463787.459552:0:24752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0bf8f9b/0x841acb7f42a3b60c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.459560:0:24752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21800 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463787.459564:0:24752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0bf8f9b/0x841acb7f42a3b60c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.459596:0:24752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0bf8f9b/0x841acb7f42a3b60c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.459609:0:24752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0bf8f9b/0x841acb7f42a3b60c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.459617:0:24752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0bf8f9b/0x841acb7f42a3b60c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.459630:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.459631:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.459633:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788463787.459819:0:24950:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:3.0:1788463787.459840:0:24950:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788463787.459846:0:24950:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1788463787.460021:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463787.460027:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5587cf8/0x841acb7f42a3b613 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.460037:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=826s v=(0 0) 00010000:00010000:0.0:1788463787.460040:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463787.460045:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5587cf8/0x841acb7f42a3b613 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.460063:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5587cf8/0x841acb7f42a3b613 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.460072:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5587cf8/0x841acb7f42a3b613 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.460080:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5587cf8/0x841acb7f42a3b613 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.460109:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788463787.460796:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463787.460803:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036c4a29d/0x841acb7f42a3b61a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.460812:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=826s v=(0 0) 00010000:00010000:0.0:1788463787.460815:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463787.460819:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036c4a29d/0x841acb7f42a3b61a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.460829:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036c4a29d/0x841acb7f42a3b61a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.460837:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036c4a29d/0x841acb7f42a3b61a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.460859:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036c4a29d/0x841acb7f42a3b61a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.460873:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788463787.460881:0:24752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788463787.460886:0:24752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5587cf8/0x841acb7f42a3b613 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.460893:0:24752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5600 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463787.460897:0:24752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5587cf8/0x841acb7f42a3b613 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.460905:0:24752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5587cf8/0x841acb7f42a3b613 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.460919:0:24752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5587cf8/0x841acb7f42a3b613 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.460926:0:24752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5587cf8/0x841acb7f42a3b613 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.460941:0:24752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463787.460944:0:24752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036c4a29d/0x841acb7f42a3b61a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.460961:0:24752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4c00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463787.460965:0:24752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036c4a29d/0x841acb7f42a3b61a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.460972:0:24752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036c4a29d/0x841acb7f42a3b61a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.460983:0:24752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036c4a29d/0x841acb7f42a3b61a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.460990:0:24752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036c4a29d/0x841acb7f42a3b61a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.461003:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.461004:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.461006:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463787.461387:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463787.461393:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af0132ca/0x841acb7f42a3b621 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.461402:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=826s v=(0 0) 00010000:00010000:0.0:1788463787.461405:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463787.461410:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af0132ca/0x841acb7f42a3b621 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.461431:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af0132ca/0x841acb7f42a3b621 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.461446:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af0132ca/0x841acb7f42a3b621 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.461453:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af0132ca/0x841acb7f42a3b621 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.461467:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463787.461474:0:24752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463787.461477:0:24752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af0132ca/0x841acb7f42a3b621 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.461484:0:24752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4400 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463787.461487:0:24752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af0132ca/0x841acb7f42a3b621 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.461495:0:24752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af0132ca/0x841acb7f42a3b621 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.461505:0:24752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af0132ca/0x841acb7f42a3b621 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.461512:0:24752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af0132ca/0x841acb7f42a3b621 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.461525:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.461532:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.461534:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463787.463222:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463787.463351:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463787.463359:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054cb8291/0x841acb7f42a3b628 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.463373:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=826s v=(0 0) 00010000:00010000:0.0:1788463787.463376:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463787.463382:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054cb8291/0x841acb7f42a3b628 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.463393:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054cb8291/0x841acb7f42a3b628 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.463403:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054cb8291/0x841acb7f42a3b628 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.463422:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054cb8291/0x841acb7f42a3b628 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.463484:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788463787.466053:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463787.466064:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000575a8600/0x841acb7f42a3b62f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.466080:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=826s v=(0 0) 00010000:00010000:0.0:1788463787.466084:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463787.466091:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000575a8600/0x841acb7f42a3b62f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.466126:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000575a8600/0x841acb7f42a3b62f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.466136:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000575a8600/0x841acb7f42a3b62f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.466155:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000575a8600/0x841acb7f42a3b62f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.468190:0:24752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788463787.468202:0:24752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054cb8291/0x841acb7f42a3b628 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.468215:0:24752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4200 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463787.468219:0:24752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054cb8291/0x841acb7f42a3b628 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.468238:0:24752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054cb8291/0x841acb7f42a3b628 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.468257:0:24752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054cb8291/0x841acb7f42a3b628 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.468264:0:24752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054cb8291/0x841acb7f42a3b628 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.468287:0:24752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463787.468291:0:24752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000575a8600/0x841acb7f42a3b62f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.468297:0:24752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5200 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463787.468300:0:24752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000575a8600/0x841acb7f42a3b62f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.468306:0:24752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000575a8600/0x841acb7f42a3b62f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.468315:0:24752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000575a8600/0x841acb7f42a3b62f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.468322:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463787.468324:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463787.468331:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463787.468818:0:24134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23372:x1875339485930112:12345-0@lo:5:osp-pre-1-1.0 Request processed in 45696us (45771us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788463787.468829:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788463787.468886:0:23372:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788463787.468894:0:23372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23372:1875339485930112:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788463787.468912:0:23372:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:3.0:1788463787.468969:0:23372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d112a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23372:1875339485930240:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788463787.469005:0:23372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463787.469029:0:23372:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188d2770c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463787.469050:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485930240 00000100:00100000:3.0:1788463787.469056:0:22637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485930240 00000100:00100000:3.0:1788463787.469786:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788463787.469799:0:22637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23372:x1875339485930240:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788463787.469857:0:22637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23372:x1875339485930240:12345-0@lo:900:osp-pre-1-1.0 Request processed in 61us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463787.469864:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788463787.469905:0:23372:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188d112a00 x1875339485930240/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788463803 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463787.469917:0:23372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d112a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23372:1875339485930240:0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1788463787.470009:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.470370:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788463787.470378:0:24133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000575a8600/0x841acb7f42a3b62f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788463787.471898:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463787.471909:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ccdc98b/0x841acb7f42a3b636 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.471924:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=826s v=(0 0) 00010000:00010000:0.0:1788463787.471928:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463787.471935:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ccdc98b/0x841acb7f42a3b636 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.471949:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ccdc98b/0x841acb7f42a3b636 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.471970:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ccdc98b/0x841acb7f42a3b636 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.471978:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ccdc98b/0x841acb7f42a3b636 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.474078:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463787.474100:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ccdc98b/0x841acb7f42a3b636 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.474114:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4e00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463787.474118:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ccdc98b/0x841acb7f42a3b636 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.474138:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ccdc98b/0x841acb7f42a3b636 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.474159:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ccdc98b/0x841acb7f42a3b636 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.474333:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788463787.474340:0:24133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ccdc98b/0x841acb7f42a3b636 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.474369:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.474371:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.474373:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463787.474901:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463787.474908:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034dccc69/0x841acb7f42a3b63d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.474920:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=826s v=(0 0) 00010000:00010000:0.0:1788463787.474924:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463787.474931:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034dccc69/0x841acb7f42a3b63d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.474944:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034dccc69/0x841acb7f42a3b63d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.474953:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034dccc69/0x841acb7f42a3b63d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.474968:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034dccc69/0x841acb7f42a3b63d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.474984:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463787.475427:0:24752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463787.475434:0:24752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034dccc69/0x841acb7f42a3b63d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.475443:0:24752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5400 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463787.475446:0:24752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034dccc69/0x841acb7f42a3b63d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.475454:0:24752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034dccc69/0x841acb7f42a3b63d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.475467:0:24752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034dccc69/0x841acb7f42a3b63d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.475475:0:24752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034dccc69/0x841acb7f42a3b63d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.475491:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463787.475493:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463787.475502:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463787.475911:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788463787.478881:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788463787.478892:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067643c40/0x841acb7f42a3b644 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.478908:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=826s v=(0 0) 00010000:00010000:1.0:1788463787.478913:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463787.478920:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067643c40/0x841acb7f42a3b644 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.478935:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067643c40/0x841acb7f42a3b644 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.478946:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067643c40/0x841acb7f42a3b644 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.478954:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067643c40/0x841acb7f42a3b644 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.479007:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788463787.479537:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788463787.479550:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6fc74a5/0x841acb7f42a3b64b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.479559:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=826s v=(0 0) 00010000:00010000:1.0:1788463787.479563:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463787.479567:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6fc74a5/0x841acb7f42a3b64b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.479840:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6fc74a5/0x841acb7f42a3b64b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.479850:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6fc74a5/0x841acb7f42a3b64b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.479858:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6fc74a5/0x841acb7f42a3b64b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.483701:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788463787.483723:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067643c40/0x841acb7f42a3b644 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.483737:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf800 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463787.483742:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067643c40/0x841acb7f42a3b644 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.483753:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067643c40/0x841acb7f42a3b644 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.483775:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067643c40/0x841acb7f42a3b644 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.483784:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067643c40/0x841acb7f42a3b644 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.483803:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463787.483807:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6fc74a5/0x841acb7f42a3b64b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.483829:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdfe00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463787.483833:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6fc74a5/0x841acb7f42a3b64b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.483841:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6fc74a5/0x841acb7f42a3b64b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.483852:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6fc74a5/0x841acb7f42a3b64b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.483860:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.483862:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.483864:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463787.490240:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788463787.490255:0:24133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6fc74a5/0x841acb7f42a3b64b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.491387:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788463787.493205:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788463787.493229:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce506f74/0x841acb7f42a3b652 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.493246:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=826s v=(0 0) 00010000:00010000:1.0:1788463787.493251:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463787.493265:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce506f74/0x841acb7f42a3b652 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.493280:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce506f74/0x841acb7f42a3b652 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.493291:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce506f74/0x841acb7f42a3b652 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.493299:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce506f74/0x841acb7f42a3b652 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463787.493320:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463787.496168:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463787.496182:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce506f74/0x841acb7f42a3b652 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.496196:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813e00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463787.496200:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce506f74/0x841acb7f42a3b652 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.496210:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce506f74/0x841acb7f42a3b652 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.496230:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce506f74/0x841acb7f42a3b652 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.496237:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce506f74/0x841acb7f42a3b652 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.496261:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463787.496263:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463787.496265:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463787.497888:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463787.497899:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c5648b9/0x841acb7f42a3b659 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.497914:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=826s v=(0 0) 00010000:00010000:3.0:1788463787.497919:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463787.497932:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c5648b9/0x841acb7f42a3b659 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.497945:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c5648b9/0x841acb7f42a3b659 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.497953:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c5648b9/0x841acb7f42a3b659 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.497960:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c5648b9/0x841acb7f42a3b659 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.497975:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463787.499998:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463787.500010:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c5648b9/0x841acb7f42a3b659 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.500023:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21e00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463787.500028:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c5648b9/0x841acb7f42a3b659 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.500039:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c5648b9/0x841acb7f42a3b659 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.500058:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c5648b9/0x841acb7f42a3b659 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.500077:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c5648b9/0x841acb7f42a3b659 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.500100:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.500102:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.500103:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463787.500917:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463787.500925:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007aca7d05/0x841acb7f42a3b660 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.500937:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=826s v=(0 0) 00010000:00010000:3.0:1788463787.500941:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463787.500946:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007aca7d05/0x841acb7f42a3b660 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.500959:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007aca7d05/0x841acb7f42a3b660 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.500969:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007aca7d05/0x841acb7f42a3b660 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.500989:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007aca7d05/0x841acb7f42a3b660 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.501007:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463787.503445:0:24752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463787.503457:0:24752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007aca7d05/0x841acb7f42a3b660 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.503470:0:24752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463787.503475:0:24752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007aca7d05/0x841acb7f42a3b660 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.503486:0:24752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007aca7d05/0x841acb7f42a3b660 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.503505:0:24752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007aca7d05/0x841acb7f42a3b660 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.503513:0:24752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007aca7d05/0x841acb7f42a3b660 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.503530:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.503532:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.503534:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463787.503891:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463787.503898:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0bf8f9b/0x841acb7f42a3b667 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.503910:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=826s v=(0 0) 00010000:00010000:3.0:1788463787.503914:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463787.503921:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0bf8f9b/0x841acb7f42a3b667 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.503934:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0bf8f9b/0x841acb7f42a3b667 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.503944:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0bf8f9b/0x841acb7f42a3b667 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.503950:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0bf8f9b/0x841acb7f42a3b667 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.503970:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463787.504187:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463787.504193:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0bf8f9b/0x841acb7f42a3b667 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.504201:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21800 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463787.504204:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0bf8f9b/0x841acb7f42a3b667 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.504212:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0bf8f9b/0x841acb7f42a3b667 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.504224:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0bf8f9b/0x841acb7f42a3b667 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.504231:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0bf8f9b/0x841acb7f42a3b667 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.504244:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.504245:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.504247:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463787.504962:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463787.504969:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3d8e441/0x841acb7f42a3b66e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.504988:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=826s v=(0 0) 00010000:00010000:3.0:1788463787.504991:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463787.504996:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3d8e441/0x841acb7f42a3b66e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.505006:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3d8e441/0x841acb7f42a3b66e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.505015:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3d8e441/0x841acb7f42a3b66e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.505021:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3d8e441/0x841acb7f42a3b66e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.505041:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463787.505600:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463787.505607:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3d8e441/0x841acb7f42a3b66e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.505615:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20e00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463787.505619:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3d8e441/0x841acb7f42a3b66e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.505641:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3d8e441/0x841acb7f42a3b66e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.505655:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3d8e441/0x841acb7f42a3b66e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.505663:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3d8e441/0x841acb7f42a3b66e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.505680:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.505682:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.505683:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463787.505915:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463787.505923:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039475443/0x841acb7f42a3b675 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.505933:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=826s v=(0 0) 00010000:00010000:3.0:1788463787.505937:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463787.505942:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039475443/0x841acb7f42a3b675 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.505951:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039475443/0x841acb7f42a3b675 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.505970:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039475443/0x841acb7f42a3b675 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.505977:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039475443/0x841acb7f42a3b675 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.505998:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463787.506433:0:24752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463787.506441:0:24752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039475443/0x841acb7f42a3b675 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.506450:0:24752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21a00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463787.506454:0:24752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039475443/0x841acb7f42a3b675 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.506463:0:24752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039475443/0x841acb7f42a3b675 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.506476:0:24752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039475443/0x841acb7f42a3b675 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.506509:0:24752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039475443/0x841acb7f42a3b675 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.506528:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.506530:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.506532:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463787.506816:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463787.506823:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b67c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.506834:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=826s v=(0 0) 00010000:00010000:3.0:1788463787.506838:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463787.506843:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b67c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.506854:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b67c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.506863:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b67c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.506871:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b67c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.506905:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463787.507234:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463787.507241:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b67c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.507249:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20600 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463787.507252:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b67c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.507261:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b67c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.507274:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b67c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.507281:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3b67c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.507296:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.507297:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.507299:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463787.507525:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463787.507531:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b61cc5be/0x841acb7f42a3b683 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.507539:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=826s v=(0 0) 00010000:00010000:3.0:1788463787.507542:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463787.507546:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b61cc5be/0x841acb7f42a3b683 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.507555:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b61cc5be/0x841acb7f42a3b683 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.507564:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b61cc5be/0x841acb7f42a3b683 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.507596:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b61cc5be/0x841acb7f42a3b683 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.507612:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463787.507982:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463787.507988:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b61cc5be/0x841acb7f42a3b683 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.507996:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618be00fe00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463787.507999:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b61cc5be/0x841acb7f42a3b683 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.508007:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b61cc5be/0x841acb7f42a3b683 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.508018:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b61cc5be/0x841acb7f42a3b683 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.508024:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b61cc5be/0x841acb7f42a3b683 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.508038:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.508039:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.508041:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463787.508133:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463787.508139:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000699d5fbc/0x841acb7f42a3b68a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.508149:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=826s v=(0 0) 00010000:00010000:3.0:1788463787.508160:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463787.508164:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000699d5fbc/0x841acb7f42a3b68a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.508175:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000699d5fbc/0x841acb7f42a3b68a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.508183:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000699d5fbc/0x841acb7f42a3b68a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.508190:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000699d5fbc/0x841acb7f42a3b68a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.508211:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463787.508455:0:24752:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463787.508461:0:24752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000699d5fbc/0x841acb7f42a3b68a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.508469:0:24752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618be00ea00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463787.508472:0:24752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000699d5fbc/0x841acb7f42a3b68a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.508502:0:24752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000699d5fbc/0x841acb7f42a3b68a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.508515:0:24752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000699d5fbc/0x841acb7f42a3b68a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.508522:0:24752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000699d5fbc/0x841acb7f42a3b68a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.508538:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.508540:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.508542:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463787.509061:0:24133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463787.509068:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d8b3fb3/0x841acb7f42a3b691 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.509079:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=826s v=(0 0) 00010000:00010000:3.0:1788463787.509083:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463787.509088:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d8b3fb3/0x841acb7f42a3b691 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.509110:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d8b3fb3/0x841acb7f42a3b691 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.509117:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d8b3fb3/0x841acb7f42a3b691 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.509131:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d8b3fb3/0x841acb7f42a3b691 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463787.509150:0:24133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788463787.509389:0:24133:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:3.0:1788463787.509513:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22653:x1875339485929600:12345-0@lo:5:osp-pre-1-0.0 Request processed in 110213us (110709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463787.509524:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1788463787.510005:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463787.510012:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d8b3fb3/0x841acb7f42a3b691 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.510021:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961880031000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463787.510026:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d8b3fb3/0x841acb7f42a3b691 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.510035:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d8b3fb3/0x841acb7f42a3b691 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.510049:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d8b3fb3/0x841acb7f42a3b691 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.510070:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d8b3fb3/0x841acb7f42a3b691 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463787.510089:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.510091:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463787.510093:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463787.514826:0:22653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22653:1875339485929600:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788463787.514851:0:22653:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1788463787.514910:0:22653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22653:1875339485930368:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788463787.514971:0:22653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463787.515004:0:22653:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788463787.515092:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485930368 00000100:00100000:2.0:1788463787.515100:0:24131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485930368 00000100:00100000:2.0:1788463787.515171:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788463787.515182:0:24131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22653:x1875339485930368:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788463787.515232:0:24131:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:3.0:1788463787.537404:0:24131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22653:x1875339485930368:12345-0@lo:5:osp-pre-1-0.0 Request processed in 22216us (22425us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788463787.537431:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788463787.538796:0:22653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22653:1875339485930368:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788463787.538817:0:22653:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000100:00100000:1.0:1788463787.909970:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485930496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463787.910056:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463787.911685:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485930496 00000100:00100000:0.0:1788463787.911715:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485930496 00000100:00100000:0.0:1788463787.911782:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788463787.911793:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485930496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788463787.911827:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788463787.911905:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485930496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (1849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463787.911912:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788463787.912016:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485930496:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788463788.046069:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463788.933940:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485930624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788463788.934020:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463788.934940:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485930624 00000100:00100000:0.0:1788463788.934952:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485930624 00000100:00100000:0.0:1788463788.935007:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788463788.935016:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485930624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788463788.935041:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788463788.935115:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485930624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463788.935123:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788463788.935170:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485930624:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788463789.071844:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463789.956076:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485930752:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463789.956143:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463789.956247:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485930752 00000100:00100000:0.0:1788463789.956255:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485930752 00000100:00100000:0.0:1788463789.956304:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788463789.956313:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485930752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788463789.956345:0:22632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788463789.958275:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463789.958298:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485930880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463789.958377:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463789.958424:0:23368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485930880 00000100:00100000:1.0:1788463789.958431:0:23368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485930880 00000100:00100000:1.0:1788463789.958464:0:23368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788463789.958472:0:23368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485930880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788463789.958499:0:23368:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788463789.958539:0:23368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485930880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463789.958546:0:23368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788463789.958609:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485930880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788463789.960098:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485930752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3780us (3948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463789.960110:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788463789.960239:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485930752:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788463790.093046:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788463790.699472:0:25306:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg453-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:0.0:1788463790.793266:0:23381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788463791.110511:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463792.133643:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788463792.246555:0:25358:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788463792.246815:0:25358:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788463792.518196:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485931136:0@lo:400:kworker.0 00000100:00100000:0.0:1788463792.525039:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463792.525198:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463792.525209:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485931264:0@lo:400:kworker.0 00000100:00100000:0.0:1788463792.525263:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463792.525296:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485931264 00000100:00100000:0.0:1788463792.525303:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485931264 00000100:00100000:0.0:1788463792.525372:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788463792.525891:0:24134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485931264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463792.525946:0:24134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485931264:12345-0@lo:400:kworker.0 Request processed in 61us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463792.525954:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788463792.525976:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463792.526006:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485931264:0@lo:400:kworker.0 00000100:00100000:0.0:1788463792.526068:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485931648:0@lo:400:kworker.0 00000100:00100000:0.0:1788463792.526094:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463792.526125:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485931136 00000100:00100000:0.0:1788463792.526129:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485931136 00000100:00100000:0.0:1788463792.526153:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485931648 00000100:00100000:0.0:1788463792.526155:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485931648 00000100:00100000:0.0:1788463792.526169:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788463792.526175:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485931136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463792.526210:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485931136:12345-0@lo:400:kworker.0 Request processed in 35us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463792.526216:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788463792.526226:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788463792.526232:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485931648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463792.527568:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485931648:12345-0@lo:400:kworker.0 Request processed in 1150us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463792.527593:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788463792.527714:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485931648:0@lo:400:kworker.0 00000100:00100000:0.0:1788463792.527727:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485931136:0@lo:400:kworker.0 00000100:00100000:0.0:1788463792.527888:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463792.527899:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485931776:0@lo:400:kworker.0 00000100:00100000:0.0:1788463792.527934:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463792.527967:0:24581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485931776 00000100:00100000:0.0:1788463792.527973:0:24581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485931776 00000100:00100000:0.0:1788463792.528017:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788463792.528024:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485931776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463792.528075:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485931776:12345-0@lo:400:kworker.0 Request processed in 51us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463792.528081:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788463792.528100:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463792.528117:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485931776:0@lo:400:kworker.0 00000100:00100000:0.0:1788463792.528156:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485932160:0@lo:400:kworker.0 00000100:00100000:0.0:1788463792.528179:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463792.528206:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485932160 00000100:00100000:0.0:1788463792.528209:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485932160 00000100:00100000:0.0:1788463792.528238:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788463792.528245:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485932160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463792.529076:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485932160:12345-0@lo:400:kworker.0 Request processed in 829us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463792.529084:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788463792.529119:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788463792.529152:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178727df80 x1875339485932160/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463792.529165:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485932160:0@lo:400:kworker.0 00000100:00100000:0.0:1788463792.529201:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463792.529210:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485932288:0@lo:400:kworker.0 00000100:00100000:0.0:1788463792.529236:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463792.529277:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485932288 00000100:00100000:0.0:1788463792.529282:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485932288 00000100:00100000:0.0:1788463792.529323:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788463792.529332:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485932288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463792.529795:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485932288:12345-0@lo:400:kworker.0 Request processed in 47us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463792.529874:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1788463792.529895:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788463792.529917:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178727df80 x1875339485932288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463792.529927:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485932288:0@lo:400:kworker.0 00000100:00100000:1.0:1788463792.530138:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:abd83a7b-f7e3-4d68-aade-6298a66ab956:3649:1875339485931008:0@lo:400:kworker.0 00000100:00100000:1.0:1788463792.530180:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463792.530210:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485931520:0@lo:400:kworker.0 00000100:00100000:1.0:1788463792.530233:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463792.530259:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485932032:0@lo:400:kworker.0 00000100:00100000:1.0:1788463792.530280:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463792.530294:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485932544:0@lo:400:kworker.0 00000100:00100000:1.0:1788463792.530330:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463792.530347:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788463792.530353:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485931392:0@lo:400:kworker.0 00000100:00100000:1.0:1788463792.530391:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463792.530407:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485931904:0@lo:400:kworker.0 00000100:00100000:1.0:1788463792.530436:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463792.530451:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485932416:0@lo:400:kworker.0 00000100:00100000:1.0:1788463792.530470:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463792.530536:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485931008 00000100:00100000:1.0:1788463792.530541:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485931008 00000100:00100000:1.0:1788463792.530570:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788463792.530600:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e699850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:3649:x1875339485931008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463792.530952:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e699850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:3649:x1875339485931008:12345-0@lo:400:kworker.0 Request processed in 353us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463792.530960:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788463792.531012:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:abd83a7b-f7e3-4d68-aade-6298a66ab956:3649:1875339485931008:0@lo:400:kworker.0 00000100:00100000:0.0:1788463792.531115:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485931520 00000100:00100000:0.0:1788463792.531120:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485931520 00000100:00100000:0.0:1788463792.531142:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485932032 00000100:00100000:0.0:1788463792.531145:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485932032 00000100:00100000:0.0:1788463792.531155:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485932544 00000100:00100000:0.0:1788463792.531158:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485932544 00000100:00100000:0.0:1788463792.531183:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485932416 00000100:00100000:0.0:1788463792.531186:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485932416 00000100:00100000:0.0:1788463792.531199:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788463792.531205:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485931520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463792.531243:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485931520:12345-0@lo:400:kworker.0 Request processed in 37us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463792.534725:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485931392 00000100:00100000:3.0:1788463792.534736:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485931392 00000100:00100000:3.0:1788463792.534794:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485931904 00000100:00100000:3.0:1788463792.534797:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485931904 00000100:00100000:3.0:1788463792.535145:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788463792.535156:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875339485931392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463792.535246:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875339485931392:12345-0@lo:400:kworker.0 Request processed in 91us (4867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463792.538164:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d112a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485932800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463792.538185:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485931392:0@lo:400:kworker.0 00010000:00080000:1.0:1788463792.538204:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178727c700 x1875339485931520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463792.538214:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485931520:0@lo:400:kworker.0 00000100:00100000:2.0:1788463792.538233:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788463792.538245:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463792.538275:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788463792.538282:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961898b25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485932672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463792.538302:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463792.538342:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485932800 00000100:00100000:2.0:1788463792.538350:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485932800 00000100:00100000:2.0:1788463792.538381:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485932672 00000100:00100000:2.0:1788463792.538384:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485932672 00000100:00100000:2.0:1788463792.538411:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788463792.538420:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf555f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875339485932800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788463792.538449:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788463792.538491:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf555f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875339485932800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463792.538497:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788463792.538518:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788463792.538523:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf555180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1875339485932672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788463792.538533:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788463792.538566:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf555180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1875339485932672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463792.538571:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788463792.538625:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961898b25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485932672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463792.538640:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d112a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485932800:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788463792.538950:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788463792.538953:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788463792.539366:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788463792.539698:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788463792.539726:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788463792.539737:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485931904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463792.539797:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485931904:12345-0@lo:400:kworker.0 Request processed in 64us (9359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463792.540349:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788463792.540512:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485931904:0@lo:400:kworker.0 00000100:00100000:1.0:1788463792.540705:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788463792.540716:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485932032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463792.540839:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485932032:12345-0@lo:400:kworker.0 Request processed in 125us (10556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463792.540845:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788463792.540884:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788463792.540893:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485932544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463792.540923:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485932544:12345-0@lo:400:kworker.0 Request processed in 33us (10593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463792.540929:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788463792.540941:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788463792.540948:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485932416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463792.540975:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485932416:12345-0@lo:400:kworker.0 Request processed in 28us (10504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463792.540981:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788463792.542953:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178727d880 x1875339485932032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463792.542975:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485932032:0@lo:400:kworker.0 00010000:00080000:3.0:1788463792.543372:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178727f480 x1875339485932544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463792.543393:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485932544:0@lo:400:kworker.0 00010000:00080000:3.0:1788463792.543431:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178727df80 x1875339485932416/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463792.543441:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485932416:0@lo:400:kworker.0 00000100:00100000:3.0:1788463793.028570:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463793.028652:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485932928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463793.028714:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463793.029041:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485932928 00000100:00100000:1.0:1788463793.029050:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485932928 00000100:00100000:1.0:1788463793.029105:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788463793.029114:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d113800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485932928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788463793.029143:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788463793.029192:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d113800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485932928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463793.029337:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485932928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463793.030301:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788463793.156461:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788463793.448968:0:25408:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788463793.449198:0:25408:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:2.0:1788463793.553845:0:24950:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:2.0:1788463793.859822:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463793.859976:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466923264 00000100:00100000:3.0:1788463793.859986:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466923264 00000100:00100000:3.0:1788463793.860032:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 117 00000100:00100000:3.0:1788463793.860041:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e69b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2399:x1875339466923264:12345-192.168.204.53@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788463793.860070:0:22621:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e9b1eb07-ba00-4022-83ff-1e9ef0c58e30@192.168.204.53@tcp t0 exp 0000000000000000 cur 833 last 0 00000020:00000080:3.0:1788463793.860098:0:22621:0:(genops.c:1385:class_connect()) connect: client e9b1eb07-ba00-4022-83ff-1e9ef0c58e30, cookie 0x841acb7f42a3b698 00000100:00080000:3.0:1788463793.860244:0:22621:0:(import.c:65:import_set_state_nolock()) ffff961786806000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788463793.860339:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e69b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+5:2399:x1875339466923264:12345-192.168.204.53@tcp:250:mount.lustre.0 Request processed in 297us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463793.860347:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 117 00000100:00100000:2.0:1788463793.886170:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463793.886564:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466923392 00000100:00100000:3.0:1788463793.886591:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466923392 00000100:00100000:3.0:1788463793.886646:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 118 00000100:00100000:3.0:1788463793.886656:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e699450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+5:18123:x1875339466923392:12345-192.168.204.53@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788463793.886688:0:22620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463793.886706:0:22620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961880030200/0x841acb7f42a3b69f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476ca1 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463793.886734:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961880030200/0x841acb7f42a3b69f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ca1 expref: 6 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463793.886747:0:22620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961880030200/0x841acb7f42a3b69f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ca1 expref: 6 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463793.886756:0:22620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961880030200, rc 0) 00000100:00100000:3.0:1788463793.886809:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e699450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+6:18123:x1875339466923392:12345-192.168.204.53@tcp:101:mount.lustre.0 Request processed in 154us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463793.886816:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 118 00000100:00100000:1.0:1788463793.895931:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463793.896111:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466923520 00000100:00100000:2.0:1788463793.896122:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466923520 00000100:00100000:2.0:1788463793.896197:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 119 00000100:00100000:2.0:1788463793.896207:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e69b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+6:18123:x1875339466923520:12345-192.168.204.53@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788463793.896781:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e69b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+6:18123:x1875339466923520:12345-192.168.204.53@tcp:501:mount.lustre.0 Request processed in 569us (853us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788463793.896791:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 119 00000100:00100000:2.0:1788463793.911637:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463793.912932:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466923648 00000100:00100000:3.0:1788463793.912945:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466923648 00000100:00100000:3.0:1788463793.913013:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 120 00000100:00100000:3.0:1788463793.913023:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e698c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+6:18123:x1875339466923648:12345-192.168.204.53@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788463793.913041:0:22620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463793.913060:0:22620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961880031800/0x841acb7f42a3b6a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476ca8 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463793.913090:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961880031800/0x841acb7f42a3b6a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ca8 expref: 7 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463793.913102:0:22620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961880031800/0x841acb7f42a3b6a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ca8 expref: 7 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463793.913132:0:22620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961880031800, rc 0) 00000100:00100000:3.0:1788463793.914339:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e698c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+7:18123:x1875339466923648:12345-192.168.204.53@tcp:101:mount.lustre.0 Request processed in 1310us (2757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463793.914351:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 120 00000100:00100000:0.0:1788463793.923984:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463793.924081:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466923776 00000100:00100000:1.0:1788463793.924091:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466923776 00000100:00100000:1.0:1788463793.924148:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 121 00000100:00100000:1.0:1788463793.924159:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e69a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+7:18123:x1875339466923776:12345-192.168.204.53@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788463793.924479:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e69a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+8:18123:x1875339466923776:12345-192.168.204.53@tcp:501:mount.lustre.0 Request processed in 199us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463793.924488:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 121 00000100:00100000:1.0:1788463793.929970:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463793.930221:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466923904 00000100:00100000:3.0:1788463793.930230:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466923904 00000100:00100000:3.0:1788463793.930473:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 122 00000100:00100000:3.0:1788463793.930485:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e69b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+8:18123:x1875339466923904:12345-192.168.204.53@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788463793.932044:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e69b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+8:18123:x1875339466923904:12345-192.168.204.53@tcp:503:mount.lustre.0 Request processed in 1550us (2072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463793.932058:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 122 00000100:00100000:3.0:1788463793.953806:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463793.954563:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466924032 00000100:00100000:2.0:1788463793.954613:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466924032 00000100:00100000:2.0:1788463793.954926:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 123 00000100:00100000:2.0:1788463793.954937:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e69a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+8:18142:x1875339466924032:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788463793.955089:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e69a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+8:18142:x1875339466924032:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 153us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463793.955097:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 123 00000100:00100000:0.0:1788463794.010011:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463794.013059:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466924160 00000100:00100000:3.0:1788463794.013076:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466924160 00000100:00100000:3.0:1788463794.013231:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 124 00000100:00100000:3.0:1788463794.013245:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e699c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+8:18142:x1875339466924160:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788463794.013522:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e699c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+8:18142:x1875339466924160:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 279us (3519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463794.013530:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 124 00000100:00100000:0.0:1788463794.032378:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463794.032471:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466924288 00000100:00100000:2.0:1788463794.032482:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466924288 00000100:00100000:2.0:1788463794.032529:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 125 00000100:00100000:2.0:1788463794.032540:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+8:18142:x1875339466924288:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788463794.032721:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+8:18142:x1875339466924288:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 182us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463794.032730:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 125 00000100:00100000:2.0:1788463794.050207:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463794.050375:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466924416 00000100:00100000:3.0:1788463794.050384:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466924416 00000100:00100000:3.0:1788463794.050442:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 126 00000100:00100000:3.0:1788463794.050453:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e698050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+8:18123:x1875339466924416:12345-192.168.204.53@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788463794.050471:0:22620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463794.050503:0:22620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961880031600/0x841acb7f42a3b6ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476cd9 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463794.050531:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961880031600/0x841acb7f42a3b6ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476cd9 expref: 9 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463794.050541:0:22620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961880031600/0x841acb7f42a3b6ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476cd9 expref: 9 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463794.050550:0:22620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961880031600, rc 0) 00000100:00100000:3.0:1788463794.050639:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e698050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+9:18123:x1875339466924416:12345-192.168.204.53@tcp:101:mount.lustre.0 Request processed in 178us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463794.050646:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 126 00000100:00100000:2.0:1788463794.052896:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788463794.052920:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961898b24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485933056:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788463794.052985:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463794.053077:0:24135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485933056 00000100:00100000:0.0:1788463794.053086:0:24135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485933056 00000100:00100000:0.0:1788463794.053148:0:24135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788463794.053170:0:24135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf555880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485933056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788463794.053204:0:24135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788463794.053249:0:24135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf555880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485933056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463794.053267:0:24135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788463794.053487:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961898b24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485933056:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788463794.053556:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463794.056488:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463794.056657:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466924544 00000100:00100000:2.0:1788463794.056668:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466924544 00000100:00100000:2.0:1788463794.056725:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 127 00000100:00100000:2.0:1788463794.056739:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e69a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+9:18123:x1875339466924544:12345-192.168.204.53@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788463794.056764:0:22618:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788463794.056799:0:22618:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788463794.056804:0:22618:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788463794.056807:0:22618:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788463794.056816:0:22618:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788463794.056819:0:22618:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1788463794.060819:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e69a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+9:18123:x1875339466924544:12345-192.168.204.53@tcp:256:mount.lustre.0 Request processed in 4068us (4332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463794.060836:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 127 00000100:00100000:1.0:1788463794.066067:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463794.066562:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466924672 00000100:00100000:3.0:1788463794.066948:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466924672 00000100:00100000:0.0:1788463794.067208:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 128 00000100:00100000:0.0:1788463794.067221:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+9:18123:x1875339466924672:12345-192.168.204.53@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788463794.067239:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463794.067266:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96188f6f4c00/0x841acb7f42a3b6b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476ce0 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463794.067306:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96188f6f4c00/0x841acb7f42a3b6b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ce0 expref: 10 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463794.067318:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96188f6f4c00/0x841acb7f42a3b6b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ce0 expref: 10 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463794.067328:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f4c00, rc 0) 00000100:00100000:0.0:1788463794.067408:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+10:18123:x1875339466924672:12345-192.168.204.53@tcp:101:mount.lustre.0 Request processed in 189us (1354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463794.067416:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 128 00000100:00100000:0.0:1788463794.070524:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463794.075608:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466924800 00000100:00100000:2.0:1788463794.075623:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466924800 00000100:00100000:2.0:1788463794.075700:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 129 00000100:00100000:2.0:1788463794.075710:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f943850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+10:18123:x1875339466924800:12345-192.168.204.53@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788463794.076129:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f943850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+10:18123:x1875339466924800:12345-192.168.204.53@tcp:501:mount.lustre.0 Request processed in 419us (5615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463794.076138:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 129 00000100:00100000:1.0:1788463794.090109:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463794.090208:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466924928 00000100:00100000:0.0:1788463794.090220:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466924928 00000100:00100000:0.0:1788463794.090293:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 130 00000100:00100000:0.0:1788463794.090304:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f943450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+10:18123:x1875339466924928:12345-192.168.204.53@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788463794.090875:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f943450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+10:18123:x1875339466924928:12345-192.168.204.53@tcp:503:mount.lustre.0 Request processed in 569us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463794.090883:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 130 00000100:00100000:1.0:1788463794.102542:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463794.104469:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466925056 00000100:00100000:3.0:1788463794.104484:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466925056 00000100:00100000:3.0:1788463794.104555:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 131 00000100:00100000:3.0:1788463794.104565:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+10:18147:x1875339466925056:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788463794.109240:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+10:18147:x1875339466925056:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 4662us (6704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463794.109257:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 131 00000100:00100000:2.0:1788463794.122176:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463794.122369:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466925184 00000100:00100000:0.0:1788463794.122380:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466925184 00000100:00100000:0.0:1788463794.122439:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 132 00000100:00100000:0.0:1788463794.122449:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+10:18147:x1875339466925184:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788463794.122639:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+10:18147:x1875339466925184:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 190us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463794.122649:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 132 00000100:00100000:1.0:1788463794.140302:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463794.140403:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463794.140480:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466925312 00000100:00100000:2.0:1788463794.140491:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466925312 00000100:00100000:2.0:1788463794.140536:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466925568 00000100:00100000:2.0:1788463794.140539:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466925568 00000100:00100000:2.0:1788463794.140554:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 7 00000100:00100000:2.0:1788463794.140562:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875339466925312:12345-192.168.204.53@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788463794.140622:0:22628:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c8274a4a-4839-4e48-85b1-f0993c4585d3@192.168.204.53@tcp t0 exp 0000000000000000 cur 833 last 0 00000020:00000080:2.0:1788463794.140701:0:22628:0:(genops.c:1385:class_connect()) connect: client c8274a4a-4839-4e48-85b1-f0993c4585d3, cookie 0x841acb7f42a3b6bb 00000004:00100000:2.0:1788463794.140728:0:22628:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788463794.140948:0:22628:0:(import.c:65:import_set_state_nolock()) ffff96178174b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788463794.141025:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:2399:x1875339466925312:12345-192.168.204.53@tcp:38:mount.lustre.0 Request processed in 461us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463794.141034:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 7 00000100:00100000:2.0:1788463794.141051:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 8 00000100:00100000:2.0:1788463794.141069:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875339466925568:12345-192.168.204.53@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788463794.141084:0:22628:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from c8274a4a-4839-4e48-85b1-f0993c4585d3@192.168.204.53@tcp t0 exp 0000000000000000 cur 833 last 0 00000020:00000080:2.0:1788463794.141116:0:22628:0:(genops.c:1385:class_connect()) connect: client c8274a4a-4839-4e48-85b1-f0993c4585d3, cookie 0x841acb7f42a3b6c2 00000004:00100000:2.0:1788463794.141127:0:22628:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788463794.141261:0:22628:0:(import.c:65:import_set_state_nolock()) ffff96178174d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788463794.141301:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:2399:x1875339466925568:12345-192.168.204.53@tcp:38:mount.lustre.0 Request processed in 230us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463794.141308:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 8 00000100:00100000:1.0:1788463794.153383:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463794.153427:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463794.153657:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466925696 00000100:00100000:0.0:1788463794.153669:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466925696 00000100:00100000:0.0:1788463794.153741:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466925440 00000100:00100000:0.0:1788463794.153744:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466925440 00000100:00100000:0.0:1788463794.153766:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 9 00000100:00100000:0.0:1788463794.153786:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:0:x1875339466925696:12345-192.168.204.53@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788463794.153837:0:22627:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788463794.153929:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:0:x1875339466925696:12345-192.168.204.53@tcp:41:mount.lustre.0 Request processed in 154us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463794.153937:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 9 00000100:00100000:0.0:1788463794.153954:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 10 00000100:00100000:0.0:1788463794.153961:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:0:x1875339466925440:12345-192.168.204.53@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788463794.153977:0:22627:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788463794.154013:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:0:x1875339466925440:12345-192.168.204.53@tcp:41:mount.lustre.0 Request processed in 52us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463794.154037:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 10 00000100:00080000:1.0:1788463794.155914:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788463794.155924:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788463794.161964:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463794.163666:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466925824 00000100:00100000:0.0:1788463794.163679:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466925824 00000100:00100000:0.0:1788463794.163772:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 11 00000100:00100000:0.0:1788463794.163784:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:18123:x1875339466925824:12345-192.168.204.53@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788463794.163819:0:22627:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788463794.163901:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:18123:x1875339466925824:12345-192.168.204.53@tcp:41:mount.lustre.0 Request processed in 119us (1947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463794.163908:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 11 00000100:00100000:1.0:1788463794.178130:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463794.179356:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466925952 00000100:00100000:2.0:1788463794.179368:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466925952 00000100:00100000:2.0:1788463794.179421:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 12 00000100:00100000:2.0:1788463794.179430:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:18123:x1875339466925952:12345-192.168.204.53@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788463794.179532:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:18123:x1875339466925952:12345-192.168.204.53@tcp:40:mount.lustre.0 Request processed in 102us (1424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463794.179539:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 12 00010000:00010000:2.0:1788463794.180723:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463794.188774:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463794.188813:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463794.188849:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463794.188873:0:24581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466926080 00000100:00100000:0.0:1788463794.188883:0:24581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466926080 00000100:00100000:0.0:1788463794.188932:0:24581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466926208 00000100:00100000:0.0:1788463794.188936:0:24581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466926208 00000100:00100000:0.0:1788463794.188958:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 19 00000100:00100000:0.0:1788463794.188967:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2399:x1875339466926080:12345-192.168.204.53@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788463794.188999:0:24581:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c8274a4a-4839-4e48-85b1-f0993c4585d3@192.168.204.53@tcp t0 exp 0000000000000000 cur 833 last 0 00000100:00100000:3.0:1788463794.189011:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466926336 00000100:00100000:3.0:1788463794.189015:0:22638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466926336 00000020:00000080:0.0:1788463794.189029:0:24581:0:(genops.c:1385:class_connect()) connect: client c8274a4a-4839-4e48-85b1-f0993c4585d3, cookie 0x841acb7f42a3b6c9 00002000:00100000:0.0:1788463794.189041:0:24581:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c8274a4a-4839-4e48-85b1-f0993c4585d3/ffff96188fb9d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:3.0:1788463794.189047:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 3 00002000:00100000:0.0:1788463794.189053:0:24581:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788463794.189054:0:22638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:18123:x1875339466926336:12345-192.168.204.53@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788463794.189137:0:22638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:18123:x1875339466926336:12345-192.168.204.53@tcp:900:mount.lustre.0 Request processed in 84us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463794.189157:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 3 00000100:00100000:3.0:1788463794.189207:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 20 00000100:00100000:3.0:1788463794.189212:0:24134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1875339466926208:12345-192.168.204.53@tcp:8:mount.lustre.0 00002000:00080000:0.0:1788463794.189224:0:24581:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00010000:00080000:3.0:1788463794.189228:0:24134:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c8274a4a-4839-4e48-85b1-f0993c4585d3@192.168.204.53@tcp t0 exp 0000000000000000 cur 833 last 0 00000020:00000080:3.0:1788463794.189245:0:24134:0:(genops.c:1385:class_connect()) connect: client c8274a4a-4839-4e48-85b1-f0993c4585d3, cookie 0x841acb7f42a3b6d0 00002000:00100000:3.0:1788463794.189250:0:24134:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c8274a4a-4839-4e48-85b1-f0993c4585d3/ffff961786802000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788463794.189262:0:24134:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788463794.189277:0:24581:0:(import.c:65:import_set_state_nolock()) ffff96188e373800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788463794.189327:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:2399:x1875339466926080:12345-192.168.204.53@tcp:8:mount.lustre.0 Request processed in 360us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463794.189335:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 19 00002000:00080000:3.0:1788463794.189378:0:24134:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788463794.189394:0:24134:0:(import.c:65:import_set_state_nolock()) ffff961786800800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788463794.189418:0:24134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:2399:x1875339466926208:12345-192.168.204.53@tcp:8:mount.lustre.0 Request processed in 204us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463794.189425:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 20 00000100:00100000:3.0:1788463794.193696:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463794.193971:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466926464 00000100:00100000:2.0:1788463794.193981:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466926464 00000100:00100000:2.0:1788463794.194032:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 0 00000100:00100000:2.0:1788463794.194043:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:18123:x1875339466926464:12345-192.168.204.53@tcp:33:mount.lustre.0 00000004:00080000:2.0:1788463794.195729:0:22629:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1589us 00000004:00200000:1.0:1788463794.262333:0:22629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788463794.262570:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:18123:x1875339466926464:12345-192.168.204.53@tcp:33:mount.lustre.0 Request processed in 68523us (68879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463794.262613:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 0 00000100:00100000:1.0:1788463794.759526:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463794.759755:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466926592 00000100:00100000:3.0:1788463794.759766:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466926592 00000100:00100000:3.0:1788463794.759829:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 13 00000100:00100000:3.0:1788463794.759840:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:18170:x1875339466926592:12345-192.168.204.53@tcp:101:mkdir.0 00010000:00010000:3.0:1788463794.759861:0:22626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463794.759886:0:22626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961880030600/0x841acb7f42a3b6d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476d11 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463794.759955:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961880031e00/0x841acb7f42a3b6de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463794.759969:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961880031e00/0x841acb7f42a3b6de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463794.759994:0:22626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961880031e00/0x841acb7f42a3b6de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463794.760043:0:22626:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788463794.760047:0:22626:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788463794.760081:0:22626:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961880031e00/0x841acb7f42a3b6de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463794.760107:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961880030600/0x841acb7f42a3b6d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d11 expref: 8 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463794.760125:0:22626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961880031e00/0x841acb7f42a3b6de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d11 expref: 7 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463794.760135:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618b7c44900) 00010000:00010000:3.0:1788463794.760138:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788463794.760142:0:22626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961880031e00, rc 0) 00000100:00100000:3.0:1788463794.760211:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+7:18170:x1875339466926592:12345-192.168.204.53@tcp:101:mkdir.0 Request processed in 373us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463794.760219:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 13 00000040:00080000:1.0:1788463794.822849:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788463795.077112:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961898b27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485933184:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463795.077230:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463795.077304:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788463795.077313:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485933312:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788463795.077398:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463795.081669:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485933184 00000100:00100000:1.0:1788463795.081691:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485933184 00000100:00100000:1.0:1788463795.081881:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485933312 00000100:00100000:1.0:1788463795.081885:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485933312 00000100:00100000:2.0:1788463795.081928:0:23368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788463795.081942:0:23368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485933184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788463795.081998:0:23368:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788463795.084259:0:23368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485933184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2306us (7015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463795.084285:0:23368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788463795.084346:0:23368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788463795.084364:0:23368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485933312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788463795.084410:0:23368:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788463795.084498:0:23368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485933312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (7158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463795.084504:0:23368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788463795.086111:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961898b27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485933184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788463795.086216:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485933312:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788463795.204198:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463796.228212:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463797.252163:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463797.639989:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788463797.640813:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d112a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485933824:0@lo:400:kworker.0 00000100:00100000:2.0:1788463797.640946:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463797.641071:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788463797.641080:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485933696:0@lo:400:kworker.0 00000100:00100000:2.0:1788463797.641114:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463797.641257:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485933952:0@lo:400:kworker.0 00000100:00100000:2.0:1788463797.641331:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463797.641366:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788463797.641374:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485933568:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788463797.641406:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463797.641442:0:24581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485933824 00000100:00100000:2.0:1788463797.641451:0:24581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485933824 00000100:00100000:2.0:1788463797.641631:0:24581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485933952 00000100:00100000:2.0:1788463797.641636:0:24581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485933952 00000100:00100000:2.0:1788463797.641661:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788463797.641672:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf556680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485933824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463797.641784:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf556680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485933824:12345-0@lo:400:kworker.0 Request processed in 112us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463797.641793:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788463797.641817:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788463797.641826:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf554380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485933952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463797.641866:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf554380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485933952:12345-0@lo:400:kworker.0 Request processed in 42us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463797.641873:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788463797.641926:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1788463797.641953:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485933952:0@lo:400:kworker.0 00000100:00100000:2.0:1788463797.641983:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d112a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485933824:0@lo:400:kworker.0 00000100:00080000:2.0:1788463797.642030:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788463797.642035:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463797.642047:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485933696 00000100:00100000:2.0:1788463797.642051:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485933696 00000100:00100000:2.0:1788463797.642079:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788463797.642085:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485933696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463797.642123:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf554e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485933696:12345-0@lo:400:kworker.0 Request processed in 39us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463797.642137:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788463797.647143:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485934080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463797.647239:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463797.647287:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d112d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:abd83a7b-f7e3-4d68-aade-6298a66ab956:3649:1875339485933440:0@lo:400:kworker.0 00000100:00100000:1.0:1788463797.647317:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463797.648888:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485933568 00000100:00100000:1.0:1788463797.648900:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485933568 00000100:00100000:1.0:1788463797.648995:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485934080 00000100:00100000:1.0:1788463797.648999:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485934080 00000100:00100000:1.0:1788463797.649015:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788463797.649024:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf556a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485933568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788463797.649057:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788463797.649129:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf556a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485933568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (7722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463797.649136:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788463797.649155:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788463797.649162:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485934080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788463797.649172:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788463797.649221:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485934080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (1973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463797.649228:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788463797.649243:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788463797.649281:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485933568:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463797.649318:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf554700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485934080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463797.650331:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485933696:0@lo:400:kworker.0 00000100:00100000:1.0:1788463797.650921:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485933440 00000100:00100000:1.0:1788463797.650927:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485933440 00000100:00100000:1.0:1788463797.650986:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788463797.650995:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:3649:x1875339485933440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463797.651053:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:3649:x1875339485933440:12345-0@lo:400:kworker.0 Request processed in 59us (3735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463797.651060:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788463797.664786:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d112d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:abd83a7b-f7e3-4d68-aade-6298a66ab956:3649:1875339485933440:0@lo:400:kworker.0 00000100:00100000:0.0:1788463797.672565:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485934464:0@lo:400:kworker.0 00000100:00100000:0.0:1788463797.674591:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463797.674640:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485934976:0@lo:400:kworker.0 00000100:00100000:0.0:1788463797.674670:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463797.674866:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788463797.674875:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d112a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485934592:0@lo:400:kworker.0 00000100:00100000:0.0:1788463797.674902:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463797.674924:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485935104:0@lo:400:kworker.0 00000100:00100000:0.0:1788463797.674945:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463797.674999:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485934976 00000100:00100000:0.0:1788463797.675006:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485934976 00000100:00100000:0.0:1788463797.675058:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485934592 00000100:00100000:0.0:1788463797.675061:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485934592 00000100:00100000:0.0:1788463797.675075:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485935104 00000100:00100000:0.0:1788463797.675077:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485935104 00000100:00100000:0.0:1788463797.675093:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788463797.675102:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875339485934976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463797.675880:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875339485934976:12345-0@lo:400:kworker.0 Request processed in 777us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463797.675888:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788463797.675908:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788463797.675915:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485934592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463797.675944:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485934592:12345-0@lo:400:kworker.0 Request processed in 31us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463797.675950:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788463797.675974:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788463797.675996:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485935104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463797.676025:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485935104:12345-0@lo:400:kworker.0 Request processed in 31us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463797.676031:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1788463797.676053:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788463797.676057:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463797.676070:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485934208:0@lo:400:kworker.0 00000100:00100000:0.0:1788463797.676095:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463797.677084:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485934720:0@lo:400:kworker.0 00000100:00100000:3.0:1788463797.677259:0:24581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485934464 00000100:00100000:3.0:1788463797.677267:0:24581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485934464 00000100:00100000:3.0:1788463797.677323:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788463797.677332:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485934464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463797.677415:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485934464:12345-0@lo:400:kworker.0 Request processed in 85us (2843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463797.677423:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788463797.677469:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485934208 00000100:00100000:3.0:1788463797.677474:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485934208 00000100:00100000:3.0:1788463797.677498:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788463797.677517:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485934208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463797.677549:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485934208:12345-0@lo:400:kworker.0 Request processed in 45us (1453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463797.677555:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788463797.677635:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d112a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485934592:0@lo:400:kworker.0 00010000:00080000:3.0:1788463797.677650:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188d1c2a00 x1875339485935104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463797.677659:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485935104:0@lo:400:kworker.0 00000100:00100000:3.0:1788463797.677670:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485934464:0@lo:400:kworker.0 00000100:00100000:3.0:1788463797.677694:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485934976:0@lo:400:kworker.0 00000100:00100000:0.0:1788463797.678138:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788463797.678280:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463797.678297:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485934720 00000100:00100000:3.0:1788463797.678301:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485934720 00000100:00100000:3.0:1788463797.678330:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788463797.678336:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485934720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463797.678395:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485934720:12345-0@lo:400:kworker.0 Request processed in 58us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463797.678402:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788463797.678429:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463797.678664:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485934208:0@lo:400:kworker.0 00000100:00100000:0.0:1788463797.679046:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485934720:0@lo:400:kworker.0 00000100:00100000:0.0:1788463797.679062:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788463797.679072:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d112d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485934336:0@lo:400:kworker.0 00000100:00100000:0.0:1788463797.679107:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463797.679148:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cfeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485934848:0@lo:400:kworker.0 00000100:00100000:0.0:1788463797.679172:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463797.679224:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485934848 00000100:00100000:0.0:1788463797.679228:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485934848 00000100:00100000:0.0:1788463797.679263:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788463797.679269:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485934848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463797.679306:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485934848:12345-0@lo:400:kworker.0 Request processed in 37us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463797.679313:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1788463797.679328:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788463797.682593:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188cfeb800 x1875339485934848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463797.682629:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cfeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485934848:0@lo:400:kworker.0 00000100:00100000:3.0:1788463797.683013:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485934336 00000100:00100000:3.0:1788463797.683021:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485934336 00000100:00100000:3.0:1788463797.683071:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788463797.683080:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485934336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463797.683191:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485934336:12345-0@lo:400:kworker.0 Request processed in 102us (4074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463797.683199:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788463797.684018:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d112d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485934336:0@lo:400:kworker.0 00000100:00100000:0.0:1788463797.699313:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463797.705446:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466926720 00000100:00100000:3.0:1788463797.705461:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466926720 00000100:00100000:3.0:1788463797.705567:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 14 00000100:00100000:3.0:1788463797.705616:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+7:18222:x1875339466926720:12345-192.168.204.53@tcp:41:lfs.0 00000004:00000024:3.0:1788463797.705654:0:22628:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788463797.705762:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+7:18222:x1875339466926720:12345-192.168.204.53@tcp:41:lfs.0 Request processed in 185us (6459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463797.705769:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 14 00000100:00080000:0.0:1788463797.708881:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463797.711930:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463797.714289:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466926848 00000100:00100000:0.0:1788463797.714305:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466926848 00000100:00100000:0.0:1788463797.714423:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 15 00000100:00100000:0.0:1788463797.714434:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:18222:x1875339466926848:12345-192.168.204.53@tcp:41:lfs.0 00000004:00000024:0.0:1788463797.714478:0:22627:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788463797.714648:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:18222:x1875339466926848:12345-192.168.204.53@tcp:41:lfs.0 Request processed in 214us (2731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463797.714656:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 15 00000100:00080000:3.0:1788463797.714685:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788463797.722125:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463797.722257:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466926976 00000100:00100000:1.0:1788463797.722272:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466926976 00000100:00100000:1.0:1788463797.722372:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 15 00000100:00100000:1.0:1788463797.722385:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf554700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:18222:x1875339466926976:12345-192.168.204.53@tcp:13:lfs.0 00002000:00000024:1.0:1788463797.722451:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788463797.722621:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf554700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:18222:x1875339466926976:12345-192.168.204.53@tcp:13:lfs.0 Request processed in 238us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463797.722630:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 15 00000100:00080000:3.0:1788463797.727735:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463797.737203:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463797.738867:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466927104 00000100:00100000:1.0:1788463797.738885:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466927104 00000100:00100000:1.0:1788463797.738994:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 16 00000100:00100000:1.0:1788463797.739007:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf555500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:18222:x1875339466927104:12345-192.168.204.53@tcp:13:lfs.0 00002000:00000024:1.0:1788463797.739047:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788463797.739186:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf555500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:18222:x1875339466927104:12345-192.168.204.53@tcp:13:lfs.0 Request processed in 181us (1997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463797.739195:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 16 00000100:00080000:3.0:1788463797.748794:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788463798.147927:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485935232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463798.148035:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463798.149526:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485935232 00000100:00100000:2.0:1788463798.149541:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485935232 00000100:00100000:2.0:1788463798.149636:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788463798.149648:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485935232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463798.149680:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788463798.149780:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485935232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (1745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463798.149788:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788463798.149953:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485935232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463798.168569:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463798.172101:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466927232 00000100:00100000:1.0:1788463798.172123:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466927232 00000100:00100000:1.0:1788463798.172237:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 134 00000100:00100000:1.0:1788463798.172250:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+10:18256:x1875339466927232:12345-192.168.204.53@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788463798.172274:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463798.172310:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961882813800/0x841acb7f42a3b6e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476d18 expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463798.172347:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961882813800/0x841acb7f42a3b6e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d18 expref: 11 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463798.172391:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961882813800/0x841acb7f42a3b6e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d18 expref: 11 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463798.172402:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882813800, rc 0) 00000100:00100000:1.0:1788463798.172497:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+11:18256:x1875339466927232:12345-192.168.204.53@tcp:101:mount.lustre.0 Request processed in 249us (3943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463798.172505:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 134 00000100:00100000:2.0:1788463798.188071:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463798.188981:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466927360 00000100:00100000:0.0:1788463798.188994:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466927360 00000100:00100000:0.0:1788463798.189068:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 135 00000100:00100000:0.0:1788463798.189081:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+11:18256:x1875339466927360:12345-192.168.204.53@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788463798.189325:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+11:18256:x1875339466927360:12345-192.168.204.53@tcp:501:mount.lustre.0 Request processed in 246us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463798.189334:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 135 00000100:00100000:2.0:1788463798.201916:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463798.203427:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466927488 00000100:00100000:3.0:1788463798.203445:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466927488 00000100:00100000:3.0:1788463798.203546:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 136 00000100:00100000:3.0:1788463798.203559:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+11:18256:x1875339466927488:12345-192.168.204.53@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788463798.203840:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+11:18256:x1875339466927488:12345-192.168.204.53@tcp:503:mount.lustre.0 Request processed in 282us (1937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463798.203849:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 136 00000100:00100000:2.0:1788463798.213220:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463798.221560:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466927616 00000100:00100000:1.0:1788463798.221596:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466927616 00000100:00100000:0.0:1788463798.222504:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 137 00000100:00100000:0.0:1788463798.222524:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+11:18262:x1875339466927616:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788463798.222814:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+11:18262:x1875339466927616:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 297us (9619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463798.222824:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 137 00010000:00010000:2.0:1788463798.276445:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463798.310710:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463798.311546:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466927744 00000100:00100000:0.0:1788463798.311564:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466927744 00000100:00100000:0.0:1788463798.311770:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 138 00000100:00100000:0.0:1788463798.311783:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+11:18262:x1875339466927744:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788463798.311985:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+11:18262:x1875339466927744:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 205us (1291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463798.311994:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 138 00000100:00100000:2.0:1788463798.323250:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463798.323558:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466927872 00000100:00100000:0.0:1788463798.323619:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466927872 00000100:00100000:0.0:1788463798.323700:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 139 00000100:00100000:0.0:1788463798.323715:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+11:18262:x1875339466927872:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788463798.324151:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+11:18262:x1875339466927872:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 437us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463798.324162:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 139 00000100:00100000:2.0:1788463798.328444:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463798.328679:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466928000 00000100:00100000:0.0:1788463798.328693:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466928000 00000100:00100000:0.0:1788463798.328765:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 140 00000100:00100000:0.0:1788463798.328781:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+11:18256:x1875339466928000:12345-192.168.204.53@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788463798.328805:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463798.328971:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96188f6f4400/0x841acb7f42a3b6ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476d49 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463798.330113:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96188f6f4400/0x841acb7f42a3b6ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d49 expref: 12 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463798.330134:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96188f6f4400/0x841acb7f42a3b6ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d49 expref: 12 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463798.330146:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f4400, rc 0) 00000100:00100000:0.0:1788463798.330249:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+12:18256:x1875339466928000:12345-192.168.204.53@tcp:101:mount.lustre.0 Request processed in 1473us (1818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463798.330259:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 140 00000100:00100000:2.0:1788463798.343855:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463798.343965:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466928128 00000100:00100000:3.0:1788463798.343978:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466928128 00000100:00100000:3.0:1788463798.344356:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 141 00000100:00100000:3.0:1788463798.344373:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+12:18256:x1875339466928128:12345-192.168.204.53@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788463798.344415:0:22620:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788463798.344449:0:22620:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788463798.344454:0:22620:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788463798.344458:0:22620:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788463798.344461:0:22620:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788463798.344464:0:22620:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1788463798.366197:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+12:18256:x1875339466928128:12345-192.168.204.53@tcp:256:mount.lustre.0 Request processed in 21811us (22339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463798.366227:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 141 00000100:00100000:0.0:1788463798.369989:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463798.370469:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466928256 00000100:00100000:2.0:1788463798.370484:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466928256 00000100:00100000:2.0:1788463798.370564:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 142 00000100:00100000:2.0:1788463798.370621:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+12:18256:x1875339466928256:12345-192.168.204.53@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788463798.370646:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463798.370680:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618c1e26200/0x841acb7f42a3b6f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476d50 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463798.370741:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618c1e26200/0x841acb7f42a3b6f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d50 expref: 13 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463798.370754:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618c1e26200/0x841acb7f42a3b6f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d50 expref: 13 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463798.370766:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e26200, rc 0) 00000100:00100000:2.0:1788463798.370856:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+13:18256:x1875339466928256:12345-192.168.204.53@tcp:101:mount.lustre.0 Request processed in 282us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463798.370864:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 142 00000100:00100000:2.0:1788463798.378459:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463798.381027:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466928384 00000100:00100000:3.0:1788463798.381048:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466928384 00000100:00100000:3.0:1788463798.381148:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 143 00000100:00100000:3.0:1788463798.381161:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+13:18256:x1875339466928384:12345-192.168.204.53@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788463798.381388:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+13:18256:x1875339466928384:12345-192.168.204.53@tcp:501:mount.lustre.0 Request processed in 229us (2942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463798.381397:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 143 00000100:00100000:3.0:1788463798.392722:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463798.393131:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466928512 00000100:00100000:0.0:1788463798.393145:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466928512 00000100:00100000:0.0:1788463798.393224:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 144 00000100:00100000:0.0:1788463798.393238:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+13:18256:x1875339466928512:12345-192.168.204.53@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788463798.393449:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+13:18256:x1875339466928512:12345-192.168.204.53@tcp:503:mount.lustre.0 Request processed in 213us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463798.393458:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 144 00000100:00100000:0.0:1788463798.401194:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463798.401398:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466928640 00000100:00100000:2.0:1788463798.401411:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466928640 00000100:00100000:2.0:1788463798.401483:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 145 00000100:00100000:2.0:1788463798.401495:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+13:18267:x1875339466928640:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788463798.401748:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+13:18267:x1875339466928640:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 254us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463798.401757:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 145 00000100:00100000:2.0:1788463798.410237:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463798.412064:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466928768 00000100:00100000:3.0:1788463798.412084:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466928768 00000100:00100000:3.0:1788463798.412175:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 146 00000100:00100000:3.0:1788463798.412189:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+13:18267:x1875339466928768:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788463798.412445:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+13:18267:x1875339466928768:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 258us (2222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463798.412466:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 146 00000100:00100000:3.0:1788463798.429708:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463798.430234:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466928896 00000100:00100000:1.0:1788463798.430247:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466928896 00000100:00100000:1.0:1788463798.430296:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 16 00000100:00100000:1.0:1788463798.430306:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875339466928896:12345-192.168.204.53@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788463798.430344:0:22626:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 57fb5382-3a22-4ad0-a646-5307bf61225a@192.168.204.53@tcp t0 exp 0000000000000000 cur 837 last 0 00000020:00000080:1.0:1788463798.430389:0:22626:0:(genops.c:1385:class_connect()) connect: client 57fb5382-3a22-4ad0-a646-5307bf61225a, cookie 0x841acb7f42a3b6fa 00000004:00100000:1.0:1788463798.430422:0:22626:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788463798.430549:0:22626:0:(import.c:65:import_set_state_nolock()) ffff961885e41000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788463798.433419:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57fb5382-3a22-4ad0-a646-5307bf61225a+6:2399:x1875339466928896:12345-192.168.204.53@tcp:38:mount.lustre.0 Request processed in 3094us (3706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463798.433437:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 16 00000100:00100000:0.0:1788463798.436951:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463798.436995:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463798.437050:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463798.437082:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463798.437111:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463798.437146:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466929152 00000100:00100000:0.0:1788463798.437159:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466929152 00000100:00100000:0.0:1788463798.437245:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466929408 00000100:00100000:0.0:1788463798.437249:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466929408 00000100:00100000:0.0:1788463798.437280:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466929536 00000100:00100000:0.0:1788463798.437283:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466929536 00000100:00100000:0.0:1788463798.437302:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 47 00000100:00100000:0.0:1788463798.437313:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+7:2401:x1875339466929408:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463798.437408:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+7:2401:x1875339466929408:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 96us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463798.437416:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 47 00000100:00100000:0.0:1788463798.437433:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 48 00000100:00100000:0.0:1788463798.437440:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:2401:x1875339466929536:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463798.437465:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:2401:x1875339466929536:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 26us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463798.437471:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 48 00000100:00100000:0.0:1788463798.437483:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 17 00000100:00100000:0.0:1788463798.437488:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875339466929152:12345-192.168.204.53@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788463798.437520:0:22627:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 57fb5382-3a22-4ad0-a646-5307bf61225a@192.168.204.53@tcp t0 exp 0000000000000000 cur 837 last 0 00000020:00000080:0.0:1788463798.437564:0:22627:0:(genops.c:1385:class_connect()) connect: client 57fb5382-3a22-4ad0-a646-5307bf61225a, cookie 0x841acb7f42a3b701 00000004:00100000:0.0:1788463798.437644:0:22627:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788463798.438553:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466929664 00000100:00100000:3.0:1788463798.438562:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466929664 00000100:00100000:3.0:1788463798.438633:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466929792 00000100:00100000:3.0:1788463798.438637:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466929792 00000100:00100000:3.0:1788463798.438676:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 12 00000100:00100000:3.0:1788463798.438686:0:24134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:2401:x1875339466929664:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463798.438739:0:24134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:2401:x1875339466929664:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 55us (1689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463798.438746:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 12 00000100:00100000:3.0:1788463798.438762:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 13 00000100:00100000:3.0:1788463798.438769:0:24134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:2401:x1875339466929792:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463798.438795:0:24134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:2401:x1875339466929792:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 27us (1684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463798.438801:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 13 00000100:00080000:0.0:1788463798.445479:0:22627:0:(import.c:65:import_set_state_nolock()) ffff96188e370800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788463798.445613:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57fb5382-3a22-4ad0-a646-5307bf61225a+6:2399:x1875339466929152:12345-192.168.204.53@tcp:38:mount.lustre.0 Request processed in 8119us (8675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463798.445627:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 17 00000100:00100000:0.0:1788463798.461703:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463798.461756:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463798.461887:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463798.471019:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466929920 00000100:00100000:2.0:1788463798.471040:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466929920 00000100:00100000:2.0:1788463798.471136:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466929024 00000100:00100000:2.0:1788463798.471140:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466929024 00000100:00100000:2.0:1788463798.471154:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466929280 00000100:00100000:2.0:1788463798.471156:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466929280 00000100:00100000:2.0:1788463798.471189:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 18 00000100:00100000:2.0:1788463798.471211:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57fb5382-3a22-4ad0-a646-5307bf61225a+7:18256:x1875339466929920:12345-192.168.204.53@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788463798.471274:0:22626:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788463798.471379:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57fb5382-3a22-4ad0-a646-5307bf61225a+7:18256:x1875339466929920:12345-192.168.204.53@tcp:41:mount.lustre.0 Request processed in 180us (9697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463798.471388:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 18 00000100:00100000:2.0:1788463798.471409:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 19 00000100:00100000:2.0:1788463798.471416:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57fb5382-3a22-4ad0-a646-5307bf61225a+6:0:x1875339466929024:12345-192.168.204.53@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788463798.471427:0:22626:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788463798.471452:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57fb5382-3a22-4ad0-a646-5307bf61225a+6:0:x1875339466929024:12345-192.168.204.53@tcp:41:mount.lustre.0 Request processed in 37us (9696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463798.471458:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 19 00000100:00100000:2.0:1788463798.471470:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 20 00000100:00100000:2.0:1788463798.471477:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57fb5382-3a22-4ad0-a646-5307bf61225a+6:0:x1875339466929280:12345-192.168.204.53@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788463798.471500:0:22626:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788463798.471532:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57fb5382-3a22-4ad0-a646-5307bf61225a+6:0:x1875339466929280:12345-192.168.204.53@tcp:41:mount.lustre.0 Request processed in 56us (9645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463798.471538:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 20 00000100:00080000:0.0:1788463798.478494:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788463798.478509:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463798.516274:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463798.516404:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466930048 00000100:00100000:1.0:1788463798.516418:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466930048 00000100:00100000:0.0:1788463798.516625:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 21 00000100:00100000:0.0:1788463798.516643:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57fb5382-3a22-4ad0-a646-5307bf61225a+6:18256:x1875339466930048:12345-192.168.204.53@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788463798.516770:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57fb5382-3a22-4ad0-a646-5307bf61225a+6:18256:x1875339466930048:12345-192.168.204.53@tcp:40:mount.lustre.0 Request processed in 133us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463798.516778:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 21 00000100:00100000:2.0:1788463798.530301:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463798.530428:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463798.530475:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463798.535391:0:24581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466930176 00000100:00100000:1.0:1788463798.535415:0:24581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466930176 00000100:00100000:1.0:1788463798.535501:0:24581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466930304 00000100:00100000:1.0:1788463798.535506:0:24581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466930304 00000100:00100000:1.0:1788463798.535609:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 21 00000100:00100000:1.0:1788463798.535620:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2399:x1875339466930176:12345-192.168.204.53@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788463798.535678:0:24581:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 57fb5382-3a22-4ad0-a646-5307bf61225a@192.168.204.53@tcp t0 exp 0000000000000000 cur 837 last 0 00000020:00000080:1.0:1788463798.535727:0:24581:0:(genops.c:1385:class_connect()) connect: client 57fb5382-3a22-4ad0-a646-5307bf61225a, cookie 0x841acb7f42a3b708 00002000:00100000:1.0:1788463798.535742:0:24581:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 57fb5382-3a22-4ad0-a646-5307bf61225a/ffff961787122800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788463798.535757:0:24581:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788463798.535849:0:24581:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788463798.535894:0:24581:0:(import.c:65:import_set_state_nolock()) ffff961787126800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788463798.535981:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:57fb5382-3a22-4ad0-a646-5307bf61225a+6:2399:x1875339466930176:12345-192.168.204.53@tcp:8:mount.lustre.0 Request processed in 362us (5553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463798.535989:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 21 00000100:00100000:1.0:1788463798.536024:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 22 00000100:00100000:1.0:1788463798.536030:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2399:x1875339466930304:12345-192.168.204.53@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788463798.536048:0:24581:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 57fb5382-3a22-4ad0-a646-5307bf61225a@192.168.204.53@tcp t0 exp 0000000000000000 cur 837 last 0 00000020:00000080:1.0:1788463798.536068:0:24581:0:(genops.c:1385:class_connect()) connect: client 57fb5382-3a22-4ad0-a646-5307bf61225a, cookie 0x841acb7f42a3b70f 00002000:00100000:1.0:1788463798.536074:0:24581:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 57fb5382-3a22-4ad0-a646-5307bf61225a/ffff961787127800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788463798.536080:0:24581:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788463798.536120:0:24581:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788463798.536138:0:24581:0:(import.c:65:import_set_state_nolock()) ffff961885295800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788463798.536163:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:57fb5382-3a22-4ad0-a646-5307bf61225a+6:2399:x1875339466930304:12345-192.168.204.53@tcp:8:mount.lustre.0 Request processed in 132us (5688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463798.536171:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 22 00000100:00100000:3.0:1788463798.545851:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466930432 00000100:00100000:3.0:1788463798.545873:0:22638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466930432 00000100:00100000:1.0:1788463798.546235:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 4 00000100:00100000:1.0:1788463798.546248:0:22638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:57fb5382-3a22-4ad0-a646-5307bf61225a+6:18256:x1875339466930432:12345-192.168.204.53@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788463798.546386:0:22638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:57fb5382-3a22-4ad0-a646-5307bf61225a+6:18256:x1875339466930432:12345-192.168.204.53@tcp:900:mount.lustre.0 Request processed in 139us (16101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463798.546395:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 4 00000100:00100000:2.0:1788463798.550128:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463798.570456:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466930560 00000100:00100000:2.0:1788463798.570480:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466930560 00000100:00100000:2.0:1788463798.570619:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 1 00000100:00100000:2.0:1788463798.570634:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:57fb5382-3a22-4ad0-a646-5307bf61225a+6:18256:x1875339466930560:12345-192.168.204.53@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788463798.570782:0:22630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788463798.570892:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:57fb5382-3a22-4ad0-a646-5307bf61225a+6:18256:x1875339466930560:12345-192.168.204.53@tcp:33:mount.lustre.0 Request processed in 263us (20778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463798.570900:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 1 00000100:00100000:3.0:1788463798.934457:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463798.934699:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466930688 00000100:00100000:1.0:1788463798.934714:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466930688 00000100:00100000:1.0:1788463798.934804:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 22 00000100:00100000:1.0:1788463798.934815:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57fb5382-3a22-4ad0-a646-5307bf61225a+6:18290:x1875339466930688:12345-192.168.204.53@tcp:101:mkdir.0 00010000:00010000:1.0:1788463798.934840:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463798.934867:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b716 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476d81 expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463798.934954:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b71d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463798.934972:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b71d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463798.934988:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b71d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463798.935542:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788463798.935548:0:22628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788463798.935619:0:22628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b71d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463798.935658:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b716 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d81 expref: 8 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463798.935696:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b71d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d81 expref: 7 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463798.935723:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618b7c44900) 00010000:00010000:1.0:1788463798.935728:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788463798.935733:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882813600, rc 0) 00000100:00100000:1.0:1788463798.935811:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57fb5382-3a22-4ad0-a646-5307bf61225a+7:18290:x1875339466930688:12345-192.168.204.53@tcp:101:mkdir.0 Request processed in 997us (2825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463798.935819:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 22 00000100:00100000:2.0:1788463799.175270:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961898b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485935360:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788463799.175393:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463799.175735:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485935360 00000100:00100000:1.0:1788463799.175748:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485935360 00000100:00100000:1.0:1788463799.175846:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788463799.175861:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485935360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788463799.175893:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788463799.175948:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485935360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463799.175955:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788463799.176010:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961898b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485935360:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788463799.176223:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788463799.299977:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788463799.690959:0:24128:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 57fb5382-3a22-4ad0-a646-5307bf61225a 00000001:00100000:1.0:1788463799.690978:0:24128:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c8274a4a-4839-4e48-85b1-f0993c4585d3 00000001:00100000:0.0:1788463799.694124:0:24950:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 57fb5382-3a22-4ad0-a646-5307bf61225a 00000001:00100000:0.0:1788463799.694138:0:24950:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c8274a4a-4839-4e48-85b1-f0993c4585d3 00000001:00100000:3.0:1788463799.697353:0:22605:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 57fb5382-3a22-4ad0-a646-5307bf61225a 00000001:00100000:3.0:1788463799.697367:0:22605:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c8274a4a-4839-4e48-85b1-f0993c4585d3 00000001:00100000:2.0:1788463799.700812:0:23360:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 57fb5382-3a22-4ad0-a646-5307bf61225a 00000001:00100000:2.0:1788463799.700825:0:23360:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c8274a4a-4839-4e48-85b1-f0993c4585d3 00000040:00080000:0.0:1788463800.004805:0:23381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788463800.196819:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485935488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788463800.196941:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463800.200833:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463800.200883:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485935616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788463800.203220:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463800.204059:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485935488 00000100:00100000:0.0:1788463800.204074:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485935488 00000100:00100000:3.0:1788463800.218541:0:23368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485935616 00000100:00100000:3.0:1788463800.218567:0:23368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485935616 00000100:00100000:3.0:1788463800.218668:0:23368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788463800.218682:0:23368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485935488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788463800.218734:0:23368:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788463800.218861:0:23368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485935488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 181us (21919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463800.218869:0:23368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788463800.218890:0:23368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788463800.218897:0:23368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485935616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788463800.218917:0:23368:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788463800.218949:0:23368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485935616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (15741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463800.218955:0:23368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788463800.220078:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485935616:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788463800.220104:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485935488:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788463800.324677:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463801.348089:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463802.376085:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463802.755752:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961898b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485935744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463802.755839:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463802.755925:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485935744 00000100:00100000:1.0:1788463802.755933:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485935744 00000100:00100000:1.0:1788463802.755987:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788463802.755997:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485935744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788463802.756025:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788463802.756082:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485935744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463802.756090:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788463802.756111:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788463802.756159:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961898b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485935744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463802.758075:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463802.758095:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961898b24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485936128:0@lo:400:kworker.0 00000100:00100000:3.0:1788463802.758172:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463802.758210:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485936512:0@lo:400:kworker.0 00000100:00100000:3.0:1788463802.758214:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961898b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:abd83a7b-f7e3-4d68-aade-6298a66ab956:3649:1875339485936000:0@lo:400:kworker.0 00000100:00100000:1.0:1788463802.758252:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463802.758257:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463802.758277:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485937024:0@lo:400:kworker.0 00000100:00100000:3.0:1788463802.758293:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485936640:0@lo:400:kworker.0 00000100:00100000:1.0:1788463802.758311:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463802.758328:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463802.758351:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485937152:0@lo:400:kworker.0 00000100:00100000:1.0:1788463802.758354:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485936128 00000100:00100000:3.0:1788463802.758371:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463802.758427:0:23368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485936512 00000100:00100000:3.0:1788463802.758430:0:23368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485936512 00000100:00100000:3.0:1788463802.758482:0:23368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788463802.758491:0:23368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485936512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463802.758541:0:23368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485936512:12345-0@lo:400:kworker.0 Request processed in 51us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463802.758548:0:23368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788463802.758569:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485936000 00000100:00100000:3.0:1788463802.758604:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485936000 00000100:00100000:3.0:1788463802.758625:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788463802.758631:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:3649:x1875339485936000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463802.758661:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:3649:x1875339485936000:12345-0@lo:400:kworker.0 Request processed in 31us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463802.758668:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788463802.758669:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485936128 00000100:00100000:1.0:1788463802.758708:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788463802.758717:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485936128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463802.758720:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961898b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:abd83a7b-f7e3-4d68-aade-6298a66ab956:3649:1875339485936000:0@lo:400:kworker.0 00000100:00100000:1.0:1788463802.758756:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485936128:12345-0@lo:400:kworker.0 Request processed in 40us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463802.758763:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788463802.758783:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485937024 00000100:00100000:1.0:1788463802.758787:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485937024 00000100:00100000:1.0:1788463802.758832:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485937152 00000100:00100000:1.0:1788463802.758836:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485937152 00000100:00100000:3.0:1788463802.758866:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961898b24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485936128:0@lo:400:kworker.0 00000100:00100000:1.0:1788463802.758977:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788463802.758985:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485937024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463802.759020:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485937024:12345-0@lo:400:kworker.0 Request processed in 35us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463802.759027:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788463802.759041:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788463802.759048:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485937152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463802.759089:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485937152:12345-0@lo:400:kworker.0 Request processed in 43us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463802.759095:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788463802.759112:0:24581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485936640 00000100:00100000:1.0:1788463802.759126:0:24581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485936640 00000100:00100000:1.0:1788463802.759157:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788463802.759164:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485936640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463802.759299:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485936640:12345-0@lo:400:kworker.0 Request processed in 33us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463802.759306:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788463802.759340:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485935872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463802.759555:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463802.759668:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485936384:0@lo:400:kworker.0 00000100:00100000:1.0:1788463802.759695:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463802.759712:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485936896:0@lo:400:kworker.0 00000100:00100000:1.0:1788463802.759730:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463802.759747:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485937408:0@lo:400:kworker.0 00000100:00100000:1.0:1788463802.759766:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463802.759783:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788463802.759789:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961898b25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485936256:0@lo:400:kworker.0 00000100:00100000:1.0:1788463802.759963:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463802.759987:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485936768:0@lo:400:kworker.0 00000100:00100000:1.0:1788463802.760009:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463802.760025:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875339485937280:0@lo:400:kworker.0 00000100:00100000:1.0:1788463802.760045:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463802.760079:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485936256 00000100:00100000:1.0:1788463802.760084:0:24131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485936256 00000100:00100000:1.0:1788463802.760111:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485936768 00000100:00100000:1.0:1788463802.760125:0:24131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485936768 00000100:00100000:1.0:1788463802.760147:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788463802.760154:0:24131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485936256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463802.760193:0:24131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485936256:12345-0@lo:400:kworker.0 Request processed in 39us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463802.761324:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788463802.761350:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788463802.761361:0:24131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485936768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463802.761671:0:24131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485936768:12345-0@lo:400:kworker.0 Request processed in 312us (1659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463802.761679:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788463802.761710:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485936384 00000100:00100000:1.0:1788463802.761717:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485936384 00000100:00100000:1.0:1788463802.761740:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485936896 00000100:00100000:1.0:1788463802.761743:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485936896 00000100:00100000:1.0:1788463802.761753:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485937408 00000100:00100000:1.0:1788463802.761755:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485937408 00000100:00100000:1.0:1788463802.761771:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485937280 00000100:00100000:1.0:1788463802.761773:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485937280 00000100:00100000:1.0:1788463802.761786:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788463802.761792:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485936384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463802.761935:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485936384:12345-0@lo:400:kworker.0 Request processed in 142us (2238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463802.761942:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788463802.761954:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788463802.761960:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485936896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463802.761997:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485936896:12345-0@lo:400:kworker.0 Request processed in 37us (2265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463802.762003:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788463802.762014:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788463802.762020:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485937408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463802.762045:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485937408:12345-0@lo:400:kworker.0 Request processed in 25us (2278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463802.762051:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788463802.762060:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788463802.762065:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875339485937280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463802.762103:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875339485937280:12345-0@lo:400:kworker.0 Request processed in 38us (2057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463802.762109:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788463802.762145:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788463802.762150:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788463802.762153:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788463802.762155:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463802.762542:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485936512:0@lo:400:kworker.0 00000100:00100000:1.0:1788463802.762563:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485937024:0@lo:400:kworker.0 00000100:00100000:1.0:1788463802.762691:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485935872 00000100:00100000:1.0:1788463802.762697:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485935872 00000100:00100000:1.0:1788463802.762742:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788463802.762749:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485935872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788463802.762766:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788463802.762803:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485935872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (3249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463802.762969:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788463802.763014:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961898b25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485936256:0@lo:400:kworker.0 00000100:00100000:1.0:1788463802.763028:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485936768:0@lo:400:kworker.0 00000100:00100000:1.0:1788463802.763038:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875339485937280:0@lo:400:kworker.0 00000100:00100000:1.0:1788463802.763052:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485935872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463802.763064:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485936384:0@lo:400:kworker.0 00000100:00100000:1.0:1788463802.763075:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485936896:0@lo:400:kworker.0 00010000:00080000:1.0:1788463802.763088:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fbeed80 x1875339485937408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463802.763097:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485937408:0@lo:400:kworker.0 00000100:00100000:1.0:1788463802.763157:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485936640:0@lo:400:kworker.0 00010000:00080000:1.0:1788463802.763170:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fbefb80 x1875339485937152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463802.763178:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485937152:0@lo:400:kworker.0 00000001:02000400:1.0:1788463803.075375:0:25506:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788463803.275035:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485937536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463803.275124:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463803.278469:0:24135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485937536 00000100:00100000:2.0:1788463803.279007:0:24135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485937536 00000100:00100000:3.0:1788463803.279453:0:24135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788463803.279467:0:24135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485937536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788463803.279515:0:24135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788463803.280241:0:24135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485937536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 776us (5115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463803.280250:0:24135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788463803.280565:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485937536:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788463803.395782:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463803.640160:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463803.640227:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463803.640274:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463803.640295:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466930944 00000100:00100000:1.0:1788463803.640310:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463803.640312:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466930944 00000100:00100000:1.0:1788463803.640381:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463803.640411:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466931456 00000100:00100000:2.0:1788463803.640418:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466931456 00000100:00100000:1.0:1788463803.640442:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463803.640455:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466931072 00000100:00100000:2.0:1788463803.640463:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466931072 00000100:00100000:1.0:1788463803.640471:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463803.640496:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 55 00000100:00100000:2.0:1788463803.640510:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:2400:x1875339466930944:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463803.640519:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463803.640595:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463803.640617:0:22628:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788463803.640630:0:22628:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788463803.640653:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466931200 00000100:00100000:0.0:1788463803.640689:0:22626:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788463803.640697:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466931584 00000100:00100000:0.0:1788463803.640702:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466931584 00000100:00100000:0.0:1788463803.640725:0:22626:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788463803.640733:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 56 00000100:00100000:0.0:1788463803.640740:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57fb5382-3a22-4ad0-a646-5307bf61225a+6:2400:x1875339466931456:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463803.641139:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466931200 00000100:00100000:1.0:1788463803.641195:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466931712 00000100:00100000:1.0:1788463803.641200:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466931712 00000100:00100000:1.0:1788463803.641216:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466931328 00000100:00100000:1.0:1788463803.641218:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466931328 00000100:00100000:1.0:1788463803.641232:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466931840 00000100:00100000:1.0:1788463803.641234:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466931840 00000100:00100000:1.0:1788463803.641251:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 17 00000100:00100000:1.0:1788463803.641259:0:24134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+5:2400:x1875339466931200:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463803.641486:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57fb5382-3a22-4ad0-a646-5307bf61225a+6:2400:x1875339466931456:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 740us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463803.641508:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 56 00000100:00100000:0.0:1788463803.641531:0:22626:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788463803.641538:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 57 00000100:00100000:0.0:1788463803.641546:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+5:2400:x1875339466931072:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463803.642105:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+5:2400:x1875339466931072:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 546us (1650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463803.642109:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:2400:x1875339466930944:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 1584us (1947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463803.642115:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 57 00000100:00100000:2.0:1788463803.642125:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 55 00000100:00100000:0.0:1788463803.642140:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 58 00000100:00100000:0.0:1788463803.642151:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57fb5382-3a22-4ad0-a646-5307bf61225a+5:2400:x1875339466931584:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463803.642164:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466930816 00000100:00100000:2.0:1788463803.642171:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466930816 00000100:00100000:2.0:1788463803.642212:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 148 00000100:00100000:2.0:1788463803.642219:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961885030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+13:2400:x1875339466930816:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463803.642257:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961885030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+13:2400:x1875339466930816:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 38us (1877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463803.642268:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 148 00000100:00100000:0.0:1788463803.642268:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57fb5382-3a22-4ad0-a646-5307bf61225a+5:2400:x1875339466931584:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 117us (1747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463803.642280:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 58 00000100:00080000:0.0:1788463803.642304:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788463803.642310:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788463803.642313:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788463803.642315:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463803.642336:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 18 00000100:00100000:2.0:1788463803.642348:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:57fb5382-3a22-4ad0-a646-5307bf61225a+5:2400:x1875339466931712:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463803.642377:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:57fb5382-3a22-4ad0-a646-5307bf61225a+5:2400:x1875339466931712:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 33us (2069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463803.642384:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 18 00000100:00100000:2.0:1788463803.642401:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 19 00000100:00100000:2.0:1788463803.642408:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+5:2400:x1875339466931328:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463803.642435:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+5:2400:x1875339466931328:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 27us (1966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463803.642440:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 19 00000100:00100000:2.0:1788463803.642453:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 20 00000100:00100000:2.0:1788463803.642459:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c08a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:57fb5382-3a22-4ad0-a646-5307bf61225a+5:2400:x1875339466931840:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463803.642482:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c08a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:57fb5382-3a22-4ad0-a646-5307bf61225a+5:2400:x1875339466931840:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 23us (1911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463803.642487:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 20 00000100:00100000:1.0:1788463803.642722:0:24134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+5:2400:x1875339466931200:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 1453us (2484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463803.642736:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 17 00000040:00080000:2.0:1788463804.036297:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788463804.292217:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788463804.292248:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485937664:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788463804.292348:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463804.293391:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485937664 00000100:00100000:1.0:1788463804.293403:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485937664 00000100:00100000:1.0:1788463804.293476:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788463804.293491:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485937664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788463804.293525:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788463804.293675:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485937664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 189us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463804.293684:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788463804.293758:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485937664:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788463804.293857:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788463804.425707:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463805.323195:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485937792:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788463805.323317:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463805.323422:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485937792 00000100:00100000:3.0:1788463805.323449:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485937792 00000100:00100000:3.0:1788463805.323512:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788463805.323523:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485937792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788463805.323569:0:22631:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788463805.323663:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485937792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 141us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463805.323673:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788463805.323741:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485937792:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788463805.324350:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485937920:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788463805.324509:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463805.337115:0:23368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485937920 00000100:00100000:2.0:1788463805.337140:0:23368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485937920 00000100:00100000:3.0:1788463805.340209:0:23368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788463805.340227:0:23368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485937920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788463805.340279:0:23368:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788463805.340402:0:23368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485937920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 179us (15892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463805.340410:0:23368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788463805.340475:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485937920:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788463805.445367:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463806.468909:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463807.500827:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788463807.805077:0:25655:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec66c7f00 20000000:00000080:2.0:1788463807.805097:0:25655:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96188e37a800 uarg=0000000000000000 20000000:01000000:2.0:1788463807.805139:0:25655:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788463807.805146:0:25655:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788463807.805151:0:25655:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788463807.806036:0:25656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1788463807.806210:0:25655:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788463807.812418:0:25655:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788463807.812450:0:25655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9618c1e27600/0x841acb7f42a3b724 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463807.812471:0:25655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961786bdfc00/0x841acb7f42a3b381 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b37a expref: 23 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463807.812549:0:25655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96188f6f5a00/0x841acb7f42a3b38f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b388 expref: 23 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463807.812557:0:25655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961882813a00/0x841acb7f42a3b3ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b3c7 expref: 23 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463807.812565:0:25655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3b548 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b541 expref: 23 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463807.812673:0:25655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96188f6f4c00/0x841acb7f42a3b6b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ce0 expref: 12 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463807.812683:0:25655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9618c1e26200/0x841acb7f42a3b6f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d50 expref: 12 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463807.812690:0:25655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9618c1e27600/0x841acb7f42a3b724 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463807.813141:0:25655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9618c1e26200/0x841acb7f42a3b6f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d50 expref: 12 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463807.813157:0:25655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9618c1e26200/0x841acb7f42a3b6f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d50 expref: 12 pid: 22621 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463807.813171:0:25655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25655:1875339485938048:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463807.813335:0:25655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96188f6f4c00/0x841acb7f42a3b6b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ce0 expref: 12 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463807.813344:0:25655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96188f6f4c00/0x841acb7f42a3b6b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ce0 expref: 12 pid: 22621 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463807.813353:0:25655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25655:1875339485938176:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463807.813397:0:25655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3b548 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3b541 expref: 23 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463807.813406:0:25655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3b548 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3b541 expref: 23 pid: 22618 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463807.813414:0:25655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25655:1875339485938304:0@lo:104: 00000100:00100000:2.0:1788463807.813451:0:25655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463807.813491:0:25655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961882813a00/0x841acb7f42a3b3ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3b3c7 expref: 23 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463807.813499:0:25655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff961882813a00/0x841acb7f42a3b3ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3b3c7 expref: 23 pid: 22621 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463807.813531:0:25655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25655:1875339485938432:0@lo:104: 00000100:00100000:2.0:1788463807.813553:0:25655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463807.813595:0:25655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96188f6f5a00/0x841acb7f42a3b38f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3b388 expref: 23 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463807.813602:0:25655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96188f6f5a00/0x841acb7f42a3b38f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3b388 expref: 23 pid: 22621 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463807.813610:0:25655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25655:1875339485938560:0@lo:104: 00000100:00100000:2.0:1788463807.813630:0:25655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463807.813646:0:25655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961786bdfc00/0x841acb7f42a3b381 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3b37a expref: 23 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463807.813653:0:25655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff961786bdfc00/0x841acb7f42a3b381 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3b37a expref: 23 pid: 22618 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463807.813660:0:25655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25655:1875339485938688:0@lo:104: 00000100:00100000:2.0:1788463807.813680:0:25655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463807.813689:0:25655:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786b21480 going to sleep for 11 seconds 00000100:00100000:3.0:1788463807.814056:0:22610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485938304 00000100:00100000:3.0:1788463807.814064:0:22610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485938304 00000100:00100000:1.0:1788463807.814086:0:22609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485938432 00000100:00100000:1.0:1788463807.814090:0:22609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485938432 00000100:00100000:3.0:1788463807.814102:0:22610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485938560 00000100:00100000:1.0:1788463807.814103:0:22609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485938688 00000100:00100000:3.0:1788463807.814104:0:22610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485938560 00000100:00100000:1.0:1788463807.814105:0:22609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485938688 00000100:00100000:3.0:1788463807.814117:0:22610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788463807.814125:0:22610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:abd83a7b-f7e3-4d68-aade-6298a66ab956+6:25655:x1875339485938304:12345-0@lo:104: 00010000:00010000:3.0:1788463807.814137:0:22610:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3b541 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3b548 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463807.814360:0:22610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788463807.814367:0:22610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:abd83a7b-f7e3-4d68-aade-6298a66ab956+6:25655:x1875339485938304:12345-0@lo:104: Request processed in 242us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463807.814533:0:25655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25655:1875339485938304:0@lo:104: 00010000:00010000:0.0:1788463807.815552:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463807.815561:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3b541 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3b548 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463807.815569:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21600 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463807.815688:0:22615:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3b541 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3b548 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463807.815698:0:22615:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3b541 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3b548 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463807.815705:0:22615:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3b541 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3b548 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463807.815718:0:22615:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788463807.816005:0:22610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788463807.816054:0:22610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788463807.816064:0:22610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:abd83a7b-f7e3-4d68-aade-6298a66ab956+5:25655:x1875339485938432:12345-0@lo:104: 00010000:00010000:3.0:1788463807.816077:0:22610:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b3c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3b3ce expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463807.816208:0:22615:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3b541 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b548 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463807.816216:0:22615:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788463807.816268:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:abd83a7b-f7e3-4d68-aade-6298a66ab956:3648:1875339485938816:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463807.816274:0:22610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788463807.816279:0:22610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:abd83a7b-f7e3-4d68-aade-6298a66ab956+5:25655:x1875339485938432:12345-0@lo:104: Request processed in 219us (2726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463807.816285:0:22610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788463807.816300:0:22610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788463807.816306:0:22610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:abd83a7b-f7e3-4d68-aade-6298a66ab956+4:25655:x1875339485938688:12345-0@lo:104: 00000100:00100000:1.0:1788463807.816306:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788463807.816315:0:22610:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a3b37a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3b381 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463807.816347:0:22610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788463807.816353:0:22610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:abd83a7b-f7e3-4d68-aade-6298a66ab956+4:25655:x1875339485938688:12345-0@lo:104: Request processed in 47us (2672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463807.816358:0:22610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788463807.816370:0:22610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788463807.816375:0:22610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:abd83a7b-f7e3-4d68-aade-6298a66ab956+3:25655:x1875339485938560:12345-0@lo:104: 00000100:00100000:2.0:1788463807.816375:0:25655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25655:1875339485938432:0@lo:104: 00010000:00010000:3.0:1788463807.816383:0:22610:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b388 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3b38f expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463807.816386:0:25655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25655:1875339485938688:0@lo:104: 00010000:00010000:3.0:1788463807.816428:0:22610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788463807.816433:0:22610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:abd83a7b-f7e3-4d68-aade-6298a66ab956+3:25655:x1875339485938560:12345-0@lo:104: Request processed in 58us (2802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463807.816439:0:22610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788463807.816456:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788463807.816461:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b3c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3b3ce expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463807.816468:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf400 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:3.0:1788463807.816471:0:22614:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b3c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3b3ce expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463807.816484:0:25655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25655:1875339485938560:0@lo:104: 00010000:00010000:3.0:1788463807.816549:0:22614:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b3c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3b3ce expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463807.816557:0:22614:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b3c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3b3ce expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463807.816562:0:22614:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788463807.816607:0:22614:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b3c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b3ce expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463807.816614:0:22614:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463807.816724:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b3c7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b3ce expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463807.816733:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961786bdf400/0x841acb7f42a3b3c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b3ce expref: -99 pid: 24127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463807.816735:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3b541 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b548 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463807.816741:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3b541 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b548 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463807.816754:0:22614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788463807.816754:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463807.816757:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b388 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3b38f expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463807.816758:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a3b37a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3b381 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463807.816764:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21c00 already unused, calling callback (ffffffffc1363c20) 00010000:00010000:0.0:1788463807.816764:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21200 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:3.0:1788463807.816768:0:22614:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a3b37a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3b381 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463807.816774:0:22614:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a3b37a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3b381 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463807.816777:0:22615:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b388 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3b38f expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463807.816781:0:22614:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a3b37a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3b381 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463807.816784:0:22615:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b388 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3b38f expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463807.816786:0:22614:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:0.0:1788463807.816800:0:22615:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b388 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3b38f expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463807.816805:0:22614:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a3b37a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b381 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463807.816806:0:22615:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788463807.816810:0:22614:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463807.816824:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a3b37a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b381 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463807.816829:0:22615:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b388 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b38f expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463807.816832:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a3b37a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b381 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463807.816835:0:22615:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463807.816840:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463807.816840:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b388 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b38f expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463807.816842:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463807.816844:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463807.816847:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961785e21200/0x841acb7f42a3b388 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3b38f expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463807.816850:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463807.816859:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463807.816860:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463807.816862:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463807.816865:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961898b26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:abd83a7b-f7e3-4d68-aade-6298a66ab956:3649:1875339485938944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463807.816893:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463807.817153:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485938816 00000100:00100000:2.0:1788463807.817159:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485938816 00000100:00100000:3.0:1788463807.817170:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961898b25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:abd83a7b-f7e3-4d68-aade-6298a66ab956:3650:1875339485939072:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788463807.817188:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3b548 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3b541 expref: 24 pid: 22618 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463807.817194:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463807.817218:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788463807.817221:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485938944 00000100:00100000:3.0:1788463807.817223:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:abd83a7b-f7e3-4d68-aade-6298a66ab956:3650:1875339485939200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788463807.817224:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485938944 00010000:00010000:2.0:1788463807.817236:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961882813a00/0x841acb7f42a3b3ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3b3c7 expref: 25 pid: 22621 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463807.817243:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463807.817246:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485939072 00000100:00100000:2.0:1788463807.817248:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485939072 00010000:00010000:2.0:1788463807.817258:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961786bdfc00/0x841acb7f42a3b381 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3b37a expref: 26 pid: 22618 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463807.817268:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485939200 00000100:00100000:2.0:1788463807.817271:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485939200 00010000:00010000:2.0:1788463807.817279:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96188f6f5a00/0x841acb7f42a3b38f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3b388 expref: 27 pid: 22621 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463807.817291:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788463807.817296:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:abd83a7b-f7e3-4d68-aade-6298a66ab956+27:3648:x1875339485938816:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463807.817339:0:24967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788463807.817346:0:24967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:abd83a7b-f7e3-4d68-aade-6298a66ab956+27:3649:x1875339485938944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788463807.817351:0:24967:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463807.817356:0:24967:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961882813a00/0x841acb7f42a3b3ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3b3c7 expref: 27 pid: 22621 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463807.817372:0:24967:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961882813a00/0x841acb7f42a3b3ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3b3c7 expref: 27 pid: 22621 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463807.817384:0:24967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961882813a00/0x841acb7f42a3b3ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3b3c7 expref: 27 pid: 22621 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463807.817395:0:24967:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463807.817422:0:24967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:abd83a7b-f7e3-4d68-aade-6298a66ab956+26:3649:x1875339485938944:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463807.817429:0:24967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788463807.817445:0:24967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788463807.817450:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961898b26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:abd83a7b-f7e3-4d68-aade-6298a66ab956:3649:1875339485938944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463807.817450:0:24967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:abd83a7b-f7e3-4d68-aade-6298a66ab956+25:3650:x1875339485939072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788463807.817457:0:24967:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463807.817462:0:24967:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961786bdfc00/0x841acb7f42a3b381 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3b37a expref: 25 pid: 22618 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463807.817470:0:24967:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961786bdfc00/0x841acb7f42a3b381 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3b37a expref: 25 pid: 22618 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463807.817487:0:24967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961786bdfc00/0x841acb7f42a3b381 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3b37a expref: 25 pid: 22618 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463807.817495:0:24967:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463807.817537:0:24967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:3650:x1875339485939072:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463807.817544:0:24967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788463807.817557:0:24967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788463807.817563:0:24967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:abd83a7b-f7e3-4d68-aade-6298a66ab956+23:3650:x1875339485939200:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463807.817567:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961898b25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:abd83a7b-f7e3-4d68-aade-6298a66ab956:3650:1875339485939072:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788463807.817571:0:24967:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463807.817594:0:24967:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96188f6f5a00/0x841acb7f42a3b38f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3b388 expref: 23 pid: 22621 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463807.817602:0:24967:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96188f6f5a00/0x841acb7f42a3b38f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3b388 expref: 23 pid: 22621 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463807.817611:0:24967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96188f6f5a00/0x841acb7f42a3b38f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3b388 expref: 23 pid: 22621 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463807.817619:0:24967:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463807.817644:0:24967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:abd83a7b-f7e3-4d68-aade-6298a66ab956+22:3650:x1875339485939200:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463807.817650:0:24967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788463807.817653:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:abd83a7b-f7e3-4d68-aade-6298a66ab956:3650:1875339485939200:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788463807.818145:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463807.818153:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3b548 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3b541 expref: 21 pid: 22618 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463807.818162:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3b548 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3b541 expref: 21 pid: 22618 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463807.818172:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3b548 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3b541 expref: 21 pid: 22618 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463807.818182:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463807.818222:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:abd83a7b-f7e3-4d68-aade-6298a66ab956+20:3648:x1875339485938816:12345-0@lo:103:ldlm_bl.0 Request processed in 925us (1915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463807.818240:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788463807.818251:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:abd83a7b-f7e3-4d68-aade-6298a66ab956:3648:1875339485938816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788463807.820855:0:25655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25655:1875339485938048:192.168.204.53@tcp:104: 00000100:00100000:2.0:1788463807.820872:0:25655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25655:1875339485938176:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463807.820910:0:25655:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9618c1e27600/0x841acb7f42a3b724 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463807.825269:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463807.826821:0:24967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466932096 00000100:00100000:1.0:1788463807.826847:0:24967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466932096 00000100:00100000:3.0:1788463807.828120:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00010000:00010000:1.0:1788463807.828467:0:24967:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96188f6f4c00/0x841acb7f42a3b6b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ce0 expref: 13 pid: 22621 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463807.839289:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466931968 00000100:00100000:1.0:1788463807.839801:0:24967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 13 00000100:00100000:1.0:1788463807.839824:0:24967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad1d6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+13:2401:x1875339466932096:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463807.839845:0:24967:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463807.839856:0:24967:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96188f6f4c00/0x841acb7f42a3b6b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ce0 expref: 13 pid: 22621 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463807.839870:0:24967:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96188f6f4c00/0x841acb7f42a3b6b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ce0 expref: 13 pid: 22621 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463807.839889:0:24967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96188f6f4c00/0x841acb7f42a3b6b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ce0 expref: 13 pid: 22621 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463807.839966:0:24967:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463807.840045:0:24967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad1d6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+12:2401:x1875339466932096:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 232us (14785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463807.840054:0:24967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 13 00000100:00100000:0.0:1788463807.840159:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466931968 00010000:00010000:0.0:1788463807.840203:0:22613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9618c1e26200/0x841acb7f42a3b6f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d50 expref: 12 pid: 22621 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463807.840905:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 14 00000100:00100000:0.0:1788463807.840916:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+12:2401:x1875339466931968:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463807.840926:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463807.840931:0:22613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9618c1e26200/0x841acb7f42a3b6f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d50 expref: 12 pid: 22621 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463807.840942:0:22613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9618c1e26200/0x841acb7f42a3b6f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d50 expref: 12 pid: 22621 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463807.840967:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618c1e26200/0x841acb7f42a3b6f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d50 expref: 12 pid: 22621 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463807.840980:0:22613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9618c1e27600/0x841acb7f42a3b724 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463807.840989:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618c1e27600/0x841acb7f42a3b724 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463807.841004:0:22613:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9618c1e27600/0x841acb7f42a3b724 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463807.841011:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9618c1e27600/0x841acb7f42a3b724 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463807.841029:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9618c1e27600/0x841acb7f42a3b724 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463807.841037:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9618c1e27600/0x841acb7f42a3b724 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463807.841043:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e27600 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463807.841047:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9618c1e27600/0x841acb7f42a3b724 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463807.841055:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9618c1e27600/0x841acb7f42a3b724 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463807.841074:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9618c1e27600/0x841acb7f42a3b724 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463807.841094:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463807.841127:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+11:2401:x1875339466931968:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 214us (13021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463807.841134:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 14 00010000:00010000:1.0:1788463807.841182:0:25655:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9618c1e27600/0x841acb7f42a3b724 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463807.841200:0:25655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9618c1e27600/0x841acb7f42a3b724 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463807.841207:0:25655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618c1e27600/0x841acb7f42a3b724 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463807.877404:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485939328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463807.877477:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463807.877537:0:24135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485939328 00000100:00100000:2.0:1788463807.877544:0:24135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485939328 00000100:00100000:2.0:1788463807.877612:0:24135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788463807.877623:0:24135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485939328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788463807.877653:0:24135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788463807.877697:0:24135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485939328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463807.877704:0:24135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788463807.877752:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485939328:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788463807.877998:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788463807.878167:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485939712:0@lo:400:kworker.0 00000100:00100000:0.0:1788463807.878213:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463807.878236:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96189162b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485940224:0@lo:400:kworker.0 00000100:00100000:0.0:1788463807.878257:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463807.878273:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961891629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485940736:0@lo:400:kworker.0 00000100:00100000:0.0:1788463807.878292:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463807.878309:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788463807.878315:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485939584:0@lo:400:kworker.0 00000100:00100000:0.0:1788463807.878335:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463807.878348:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96189162a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485940096:0@lo:400:kworker.0 00000100:00100000:0.0:1788463807.878365:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463807.878376:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961891629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875339485940608:0@lo:400:kworker.0 00000100:00100000:0.0:1788463807.878414:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463807.878439:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485939712 00000100:00100000:0.0:1788463807.878444:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485939712 00000100:00100000:0.0:1788463807.878471:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485940224 00000100:00100000:0.0:1788463807.878474:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485940224 00000100:00100000:0.0:1788463807.878484:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485940736 00000100:00100000:0.0:1788463807.878487:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485940736 00000100:00100000:0.0:1788463807.878505:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485940608 00000100:00100000:0.0:1788463807.878507:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485940608 00000100:00100000:0.0:1788463807.878532:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788463807.878538:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485939712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463807.878590:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485939712:12345-0@lo:400:kworker.0 Request processed in 52us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463807.878596:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788463807.878610:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788463807.878616:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485940224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463807.878639:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485940224:12345-0@lo:400:kworker.0 Request processed in 24us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463807.878644:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788463807.878652:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788463807.878657:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485940736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463807.878676:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485940736:12345-0@lo:400:kworker.0 Request processed in 20us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463807.878681:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788463807.878689:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788463807.878693:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875339485940608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463807.878711:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875339485940608:12345-0@lo:400:kworker.0 Request processed in 18us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463807.878716:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1788463807.878730:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788463807.878732:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788463807.878741:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485939840:0@lo:400:kworker.0 00000100:00100000:0.0:1788463807.878764:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463807.878780:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96189162ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485940352:0@lo:400:kworker.0 00000100:00100000:0.0:1788463807.878809:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463807.878825:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788463807.878831:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485939456:0@lo:400:kworker.0 00000100:00100000:0.0:1788463807.878849:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463807.878863:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485939968:0@lo:400:kworker.0 00000100:00100000:0.0:1788463807.878883:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463807.878901:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961891628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485940480:0@lo:400:kworker.0 00000100:00100000:0.0:1788463807.878919:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463807.878941:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485939840 00000100:00100000:0.0:1788463807.878945:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485939840 00000100:00100000:0.0:1788463807.878968:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485939456 00000100:00100000:0.0:1788463807.878972:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485939456 00000100:00100000:0.0:1788463807.878984:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788463807.878989:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485939840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463807.879037:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485939840:12345-0@lo:400:kworker.0 Request processed in 47us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463807.879044:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788463807.879055:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788463807.879061:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485939456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463807.879089:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485939456:12345-0@lo:400:kworker.0 Request processed in 29us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463807.879095:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788463807.879111:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485939584 00000100:00100000:0.0:1788463807.879114:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485939584 00000100:00100000:0.0:1788463807.879142:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485940096 00000100:00100000:0.0:1788463807.879145:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485940096 00000100:00100000:0.0:1788463807.879157:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485939968 00000100:00100000:0.0:1788463807.879165:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485939968 00000100:00100000:0.0:1788463807.879181:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788463807.881376:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485940352 00000100:00100000:3.0:1788463807.881390:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485940352 00000100:00100000:3.0:1788463807.881439:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485940480 00000100:00100000:3.0:1788463807.881442:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485940480 00000100:00100000:3.0:1788463807.881460:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788463807.881469:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485940352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463807.881545:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485940352:12345-0@lo:400:kworker.0 Request processed in 77us (2734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463807.881552:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788463807.881567:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788463807.881591:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485940480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463807.881620:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485940480:12345-0@lo:400:kworker.0 Request processed in 48us (2699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463807.881642:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788463807.881689:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961891629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875339485940608:0@lo:400:kworker.0 00000100:00100000:3.0:1788463807.881702:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485939712:0@lo:400:kworker.0 00000100:00100000:3.0:1788463807.881711:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96189162b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485940224:0@lo:400:kworker.0 00010000:00080000:3.0:1788463807.881724:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961891629880 x1875339485940736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463807.881734:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961891629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485940736:0@lo:400:kworker.0 00000100:00100000:3.0:1788463807.881768:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463807.881779:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961898b26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485940864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463807.881814:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463807.881853:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485939456:0@lo:400:kworker.0 00010000:00080000:3.0:1788463807.881865:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961891628000 x1875339485940480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463807.881874:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961891628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485940480:0@lo:400:kworker.0 00000100:00100000:3.0:1788463807.881885:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485939840:0@lo:400:kworker.0 00000100:00100000:3.0:1788463807.881894:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96189162ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485940352:0@lo:400:kworker.0 00000100:00100000:2.0:1788463807.883297:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788463807.883316:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485940096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463807.883387:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485940096:12345-0@lo:400:kworker.0 Request processed in 80us (5021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463807.883393:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788463807.883413:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788463807.883419:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485939968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463807.883475:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485939968:12345-0@lo:400:kworker.0 Request processed in 56us (4591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463807.883482:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788463807.883507:0:24135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485940864 00000100:00100000:2.0:1788463807.883513:0:24135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485940864 00000100:00100000:2.0:1788463807.883545:0:24135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788463807.883551:0:24135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485940864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788463807.883565:0:24135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788463807.883617:0:24135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485940864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463807.883623:0:24135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788463807.883668:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96189162a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485940096:0@lo:400:kworker.0 00000100:00100000:2.0:1788463807.883703:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961898b26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485940864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788463807.883728:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485939968:0@lo:400:kworker.0 00000100:00100000:0.0:1788463807.884080:0:24134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485939584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463807.884249:0:24134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485939584:12345-0@lo:400:kworker.0 Request processed in 5062us (5912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463807.884256:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788463807.884280:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788463807.884285:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788463807.884287:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788463807.884290:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463807.884867:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485939584:0@lo:400:kworker.0 00000100:00100000:0.0:1788463808.390784:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788463808.390808:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485940992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463808.390895:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463808.391044:0:24135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485940992 00000100:00100000:2.0:1788463808.391054:0:24135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485940992 00000100:00100000:2.0:1788463808.391118:0:24135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788463808.391128:0:24135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485940992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463808.391161:0:24135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788463808.391234:0:24135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485940992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463808.391241:0:24135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788463808.391409:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485940992:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788463808.515814:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463808.753670:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463808.753706:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463808.753743:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463808.753792:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463808.753814:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463808.753832:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463808.753848:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463808.753865:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463808.753890:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463808.753918:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466932480 00000100:00100000:3.0:1788463808.753941:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466932480 00000100:00100000:3.0:1788463808.753991:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466932992 00000100:00100000:3.0:1788463808.753994:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466932992 00000100:00100000:3.0:1788463808.754021:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466932352 00000100:00100000:3.0:1788463808.754024:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466932352 00000100:00100000:3.0:1788463808.754035:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466932864 00000100:00100000:3.0:1788463808.754038:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466932864 00000100:00100000:3.0:1788463808.754052:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 65 00000100:00100000:3.0:1788463808.754061:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+5:2400:x1875339466932480:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463808.754139:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+5:2400:x1875339466932480:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 78us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463808.754147:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 65 00000100:00100000:3.0:1788463808.754166:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 66 00000100:00100000:3.0:1788463808.754172:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57fb5382-3a22-4ad0-a646-5307bf61225a+5:2400:x1875339466932992:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463808.754212:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57fb5382-3a22-4ad0-a646-5307bf61225a+5:2400:x1875339466932992:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 39us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463808.754218:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 66 00000100:00100000:3.0:1788463808.754230:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 67 00000100:00100000:3.0:1788463808.754237:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:2400:x1875339466932352:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463808.754260:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:2400:x1875339466932352:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 24us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463808.754273:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 67 00000100:00100000:3.0:1788463808.754285:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 68 00000100:00100000:3.0:1788463808.754303:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57fb5382-3a22-4ad0-a646-5307bf61225a+6:2400:x1875339466932864:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463808.754328:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57fb5382-3a22-4ad0-a646-5307bf61225a+6:2400:x1875339466932864:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 37us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463808.754334:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 68 00000100:00100000:0.0:1788463808.755537:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466932224 00000100:00100000:0.0:1788463808.755549:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466932224 00000100:00100000:0.0:1788463808.755644:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 149 00000100:00100000:0.0:1788463808.755654:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+11:2400:x1875339466932224:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463808.755709:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+11:2400:x1875339466932224:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 56us (2050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463808.755716:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 149 00000100:00100000:0.0:1788463808.755751:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466932736 00000100:00100000:0.0:1788463808.755755:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466932736 00000100:00100000:0.0:1788463808.755776:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466933248 00000100:00100000:0.0:1788463808.755780:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466933248 00000100:00100000:0.0:1788463808.755793:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466932608 00000100:00100000:0.0:1788463808.755796:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466932608 00000100:00100000:0.0:1788463808.755808:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466933120 00000100:00100000:0.0:1788463808.755810:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466933120 00000100:00100000:0.0:1788463808.755823:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 24 00000100:00100000:0.0:1788463808.755843:0:24134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+5:2400:x1875339466932736:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463808.755870:0:24134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+5:2400:x1875339466932736:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 29us (2127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463808.755876:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 24 00000100:00100000:0.0:1788463808.755888:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 25 00000100:00100000:0.0:1788463808.755894:0:24134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961898b25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:57fb5382-3a22-4ad0-a646-5307bf61225a+5:2400:x1875339466933248:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463808.755916:0:24134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961898b25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:57fb5382-3a22-4ad0-a646-5307bf61225a+5:2400:x1875339466933248:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 23us (2102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463808.755922:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 25 00000100:00100000:0.0:1788463808.755951:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 26 00000100:00100000:0.0:1788463808.755958:0:24134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+5:2400:x1875339466932608:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463808.755982:0:24134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+5:2400:x1875339466932608:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 25us (2133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463808.755988:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 26 00000100:00100000:0.0:1788463808.756010:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 27 00000100:00100000:0.0:1788463808.756017:0:24134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:57fb5382-3a22-4ad0-a646-5307bf61225a+5:2400:x1875339466933120:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463808.756039:0:24134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:57fb5382-3a22-4ad0-a646-5307bf61225a+5:2400:x1875339466933120:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 23us (2148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463808.756045:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 27 00000100:00080000:0.0:1788463808.756068:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788463808.756072:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788463808.756075:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788463808.756078:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788463809.134908:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463809.135027:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466933376 00000100:00100000:2.0:1788463809.135050:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466933376 00000100:00100000:2.0:1788463809.135118:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 150 00000100:00100000:2.0:1788463809.135129:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+11:18137:x1875339466933376:12345-192.168.204.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463809.135144:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463809.135164:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3b72b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476d88 expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.135191:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3b72b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d88 expref: 12 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.135203:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3b72b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d88 expref: 12 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.135212:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e26400, rc 0) 00000100:00100000:2.0:1788463809.135275:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+12:18137:x1875339466933376:12345-192.168.204.53@tcp:101:ll_cfg_requeue.0 Request processed in 148us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463809.135283:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 150 00000100:00100000:1.0:1788463809.141546:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463809.141710:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466933504 00000100:00100000:3.0:1788463809.141722:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466933504 00000100:00100000:3.0:1788463809.141785:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 151 00000100:00100000:3.0:1788463809.141797:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+12:18137:x1875339466933504:12345-192.168.204.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463809.142008:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+12:18137:x1875339466933504:12345-192.168.204.53@tcp:501:ll_cfg_requeue.0 Request processed in 212us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463809.142016:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 151 00000100:00100000:1.0:1788463809.178423:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463809.179899:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466933632 00000100:00100000:3.0:1788463809.179913:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466933632 00000100:00100000:3.0:1788463809.180704:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 152 00000100:00100000:3.0:1788463809.180717:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+12:18137:x1875339466933632:12345-192.168.204.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788463809.181159:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+12:18137:x1875339466933632:12345-192.168.204.53@tcp:503:ll_cfg_requeue.0 Request processed in 442us (2744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463809.181167:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 152 00000100:00100000:1.0:1788463809.204099:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463809.206522:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466933760 00000100:00100000:0.0:1788463809.206551:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466933760 00000100:00100000:0.0:1788463809.206648:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 153 00000100:00100000:0.0:1788463809.206658:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+12:18137:x1875339466933760:12345-192.168.204.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463809.206675:0:22620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463809.206694:0:22620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96188f6f5400/0x841acb7f42a3b732 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476d8f expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463809.206728:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96188f6f5400/0x841acb7f42a3b732 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d8f expref: 13 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463809.206740:0:22620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96188f6f5400/0x841acb7f42a3b732 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d8f expref: 13 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463809.206751:0:22620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f5400, rc 0) 00000100:00100000:0.0:1788463809.206827:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+13:18137:x1875339466933760:12345-192.168.204.53@tcp:101:ll_cfg_requeue.0 Request processed in 170us (2738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463809.206835:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 153 00000100:00100000:1.0:1788463809.210111:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463809.210250:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466933888 00000100:00100000:3.0:1788463809.210261:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466933888 00000100:00100000:3.0:1788463809.210332:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 154 00000100:00100000:3.0:1788463809.210356:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+13:18137:x1875339466933888:12345-192.168.204.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463809.210516:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+13:18137:x1875339466933888:12345-192.168.204.53@tcp:501:ll_cfg_requeue.0 Request processed in 161us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463809.210523:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 154 00000100:00100000:0.0:1788463809.216129:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463809.216422:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466934016 00000100:00100000:3.0:1788463809.216435:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466934016 00000100:00100000:3.0:1788463809.216612:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 155 00000100:00100000:3.0:1788463809.216625:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+13:18137:x1875339466934016:12345-192.168.204.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788463809.216923:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+13:18137:x1875339466934016:12345-192.168.204.53@tcp:503:ll_cfg_requeue.0 Request processed in 299us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463809.216934:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 155 00000100:00100000:1.0:1788463809.413756:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788463809.413785:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485941120:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788463809.415404:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463809.416109:0:24135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485941120 00000100:00100000:2.0:1788463809.416123:0:24135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485941120 00000100:00100000:2.0:1788463809.416230:0:24135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788463809.416244:0:24135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485941120:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788463809.416549:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788463809.416878:0:24135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788463809.417428:0:24135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485941120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1174us (2021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463809.417439:0:24135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788463809.423163:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485941120:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788463809.540888:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788463809.799951:0:22623:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788463809.799963:0:22623:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9618a4d38000 from 13 10000000:01000000:3.0:1788463809.799972:0:22623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788463809.800060:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a3b739 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463809.800073:0:22623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a3b739 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463809.800086:0:22623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a3b739 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463809.800121:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485941248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788463809.800231:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463809.800318:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618843e2480 going to sleep for 11 seconds 00000100:00100000:0.0:1788463809.801675:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485941248 00000100:00100000:0.0:1788463809.801691:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485941248 00000100:00100000:0.0:1788463809.801794:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788463809.801806:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+20:22623:x1875339485941248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463809.801827:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463809.801849:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96188f6f4e00/0x841acb7f42a3b740 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b739 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463809.801885:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96188f6f4e00/0x841acb7f42a3b740 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b739 expref: 21 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463809.801913:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96188f6f4e00/0x841acb7f42a3b740 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b739 expref: 21 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463809.801925:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f4e00, rc 0) 00000100:00100000:0.0:1788463809.802050:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:22623:x1875339485941248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 246us (1818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463809.802057:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788463809.807794:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485941248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463809.807841:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a3b739 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b740 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463809.807857:0:22623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a3b739 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b740 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463809.807997:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485941376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463809.808088:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463809.808231:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485941376 00000100:00100000:3.0:1788463809.808261:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618843e2480 going to sleep for 11 seconds 00000100:00100000:0.0:1788463809.809951:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485941376 00000100:00100000:0.0:1788463809.810063:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788463809.810076:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:22623:x1875339485941376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463809.811075:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:22623:x1875339485941376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 993us (2980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463809.811086:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788463809.811676:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485941376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463809.811745:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485941504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788463809.811819:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463809.811863:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618843e2480 going to sleep for 11 seconds 00000100:00100000:0.0:1788463809.812851:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485941504 00000100:00100000:0.0:1788463809.812865:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485941504 00000100:00100000:0.0:1788463809.812943:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788463809.812955:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:22623:x1875339485941504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788463809.813151:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:22623:x1875339485941504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 197us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463809.813160:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788463809.813263:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485941504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788463809.815517:0:25668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788463809.816254:0:22623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788463809.816297:0:22623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788463809.816312:0:22623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a3b739 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b740 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463809.816327:0:22623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a3b739 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b740 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463809.816341:0:22623:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788463809.816344:0:22623:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9618c16bd800 from 13 10000000:01000000:3.0:1788463809.816347:0:22623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788463809.816404:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961880030600/0x841acb7f42a3b747 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463809.816428:0:22623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961880030600/0x841acb7f42a3b747 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463809.816442:0:22623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961880030600/0x841acb7f42a3b747 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463809.816487:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485941632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788463809.816639:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463809.816685:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618843e2480 going to sleep for 11 seconds 00000100:00100000:0.0:1788463809.817214:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485941632 00000100:00100000:0.0:1788463809.817225:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485941632 00000100:00100000:0.0:1788463809.817311:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788463809.817321:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+21:22623:x1875339485941632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463809.817351:0:22620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463809.817371:0:22620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96188f6f5200/0x841acb7f42a3b74e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b747 expref: -99 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463809.817403:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96188f6f5200/0x841acb7f42a3b74e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b747 expref: 22 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463809.817416:0:22620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96188f6f5200/0x841acb7f42a3b74e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b747 expref: 22 pid: 22620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463809.817425:0:22620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f5200, rc 0) 00000100:00100000:0.0:1788463809.817504:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+22:22623:x1875339485941632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463809.817511:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788463809.817761:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485941632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463809.817804:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961880030600/0x841acb7f42a3b747 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b74e expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.817815:0:22623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961880030600/0x841acb7f42a3b747 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b74e expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463809.817922:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485941760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463809.817961:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463809.818008:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786b213c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463809.818027:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485941760 00000100:00100000:2.0:1788463809.818031:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485941760 00000100:00100000:2.0:1788463809.818054:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788463809.818061:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+22:22623:x1875339485941760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463809.818192:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+22:22623:x1875339485941760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463809.818199:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788463809.818237:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485941760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463809.818265:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485941888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463809.818325:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463809.818339:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786b213c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463809.818350:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485941888 00000100:00100000:2.0:1788463809.818353:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485941888 00000100:00100000:2.0:1788463809.818369:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788463809.818376:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+22:22623:x1875339485941888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463809.818466:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+22:22623:x1875339485941888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463809.818483:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788463809.818522:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485941888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788463809.819249:0:25669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788463809.819315:0:22623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788463809.819338:0:22623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788463809.819348:0:22623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961880030600/0x841acb7f42a3b747 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b74e expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.819359:0:22623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961880030600/0x841acb7f42a3b747 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b74e expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463809.819372:0:22623:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788463809.819375:0:22623:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff961787d22000 from 13 10000000:01000000:2.0:1788463809.819378:0:22623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788463809.819413:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c1e27600/0x841acb7f42a3b755 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.819422:0:22623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff9618c1e27600/0x841acb7f42a3b755 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.819432:0:22623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff9618c1e27600/0x841acb7f42a3b755 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463809.819448:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485942016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788463809.819489:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463809.819523:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f6d2180 going to sleep for 11 seconds 00000100:00100000:2.0:1788463809.819541:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485942016 00000100:00100000:2.0:1788463809.819546:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485942016 00000100:00100000:2.0:1788463809.819616:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788463809.819624:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+22:22623:x1875339485942016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463809.819635:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463809.819650:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618c1e26200/0x841acb7f42a3b75c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b755 expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.819672:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618c1e26200/0x841acb7f42a3b75c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b755 expref: 23 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.819684:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618c1e26200/0x841acb7f42a3b75c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b755 expref: 23 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.819692:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e26200, rc 0) 00000100:00100000:2.0:1788463809.819727:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+23:22623:x1875339485942016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463809.819734:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788463809.819772:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485942016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463809.819787:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff9618c1e27600/0x841acb7f42a3b755 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b75c expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.819798:0:22623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff9618c1e27600/0x841acb7f42a3b755 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b75c expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463809.819846:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485942144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463809.819872:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463809.819889:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f6d2180 going to sleep for 11 seconds 00000100:00100000:2.0:1788463809.819900:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485942144 00000100:00100000:2.0:1788463809.819903:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485942144 00000100:00100000:2.0:1788463809.819925:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788463809.819931:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+23:22623:x1875339485942144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463809.820045:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+23:22623:x1875339485942144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463809.820052:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788463809.820077:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485942144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463809.820102:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485942272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463809.820145:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463809.820158:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f6d2180 going to sleep for 11 seconds 00000100:00100000:2.0:1788463809.820168:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485942272 00000100:00100000:2.0:1788463809.820171:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485942272 00000100:00100000:2.0:1788463809.820187:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788463809.820192:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+23:22623:x1875339485942272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463809.820264:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+23:22623:x1875339485942272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463809.820270:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788463809.820306:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485942272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788463809.824219:0:25670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788463809.825220:0:22623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788463809.825515:0:22623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788463809.826089:0:22623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c1e27600/0x841acb7f42a3b755 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b75c expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463809.826107:0:22623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff9618c1e27600/0x841acb7f42a3b755 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b75c expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463809.826213:0:22623:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788463809.826218:0:22623:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9618bf5d9000 from 13 10000000:01000000:1.0:1788463809.826221:0:22623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788463809.828313:0:22623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882813c00/0x841acb7f42a3b763 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.828336:0:22623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961882813c00/0x841acb7f42a3b763 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.828349:0:22623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961882813c00/0x841acb7f42a3b763 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463809.828383:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485942400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788463809.828714:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463809.828780:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff961788cf2240 going to sleep for 11 seconds 00000100:00100000:2.0:1788463809.829197:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485942400 00000100:00100000:2.0:1788463809.829209:0:22618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485942400 00000100:00100000:2.0:1788463809.829304:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788463809.829316:0:22618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+23:22623:x1875339485942400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463809.829334:0:22618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463809.829355:0:22618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618c1e26600/0x841acb7f42a3b76a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3b763 expref: -99 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.829413:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618c1e26600/0x841acb7f42a3b76a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3b763 expref: 24 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.829426:0:22618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618c1e26600/0x841acb7f42a3b76a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3b763 expref: 24 pid: 22618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.829439:0:22618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e26600, rc 0) 00000100:00100000:2.0:1788463809.829527:0:22618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:22623:x1875339485942400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463809.829546:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788463809.829714:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485942400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463809.829736:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961882813c00/0x841acb7f42a3b763 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b76a expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.829749:0:22623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961882813c00/0x841acb7f42a3b763 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3b76a expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463809.829861:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485942528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463809.829908:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463809.830010:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff961788cf2240 going to sleep for 11 seconds 00000100:00100000:0.0:1788463809.830708:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485942528 00000100:00100000:0.0:1788463809.830718:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485942528 00000100:00100000:0.0:1788463809.830774:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788463809.830785:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:22623:x1875339485942528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463809.831500:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:22623:x1875339485942528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 709us (1583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463809.831530:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788463809.832170:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485942528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463809.832312:0:22623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485942656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788463809.832380:0:22623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463809.832483:0:22623:0:(client.c:2716:ptlrpc_set_wait()) set ffff961788cf2240 going to sleep for 11 seconds 00000100:00100000:0.0:1788463809.832670:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485942656 00000100:00100000:0.0:1788463809.832679:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485942656 00000100:00100000:0.0:1788463809.832731:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788463809.832741:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:22623:x1875339485942656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788463809.832989:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:22623:x1875339485942656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 238us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463809.832998:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788463809.833239:0:22623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:abd83a7b-f7e3-4d68-aade-6298a66ab956:22623:1875339485942656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788463809.835687:0:25671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788463809.837748:0:22623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788463809.837863:0:22623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788463809.837880:0:22623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882813c00/0x841acb7f42a3b763 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b76a expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.837896:0:22623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961882813c00/0x841acb7f42a3b763 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3b76a expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463809.903510:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463809.903860:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466934144 00000100:00100000:3.0:1788463809.903876:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466934144 00000100:00100000:3.0:1788463809.903964:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 23 00000100:00100000:3.0:1788463809.903991:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:18762:x1875339466934144:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788463809.904019:0:22626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463809.904058:0:22626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961880030800/0x841acb7f42a3b771 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476d96 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463809.904359:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b778 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463809.904377:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b778 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463809.904393:0:22626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b778 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463809.904412:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3b77f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463809.904439:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3b77f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463809.904446:0:22626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3b77f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463809.904555:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961880030c00/0x841acb7f42a3b786 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463809.904564:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961880030c00/0x841acb7f42a3b786 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463809.904572:0:22626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961880030c00/0x841acb7f42a3b786 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463809.905346:0:22626:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788463809.905353:0:22626:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788463809.905414:0:22626:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961880030c00/0x841acb7f42a3b786 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.905432:0:22626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b778 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.905439:0:22626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b778 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.905448:0:22626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b778 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.905455:0:22626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961880031400 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463809.905460:0:22626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b778 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.905468:0:22626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b778 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.905503:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618b7c44900) 00010000:00010000:2.0:1788463809.905506:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463809.905512:0:22626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b778 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.905520:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b778 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.905544:0:22626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3b77f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.905551:0:22626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3b77f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.905556:0:22626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3b77f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.905562:0:22626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961880030e00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463809.905565:0:22626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3b77f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.905571:0:22626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3b77f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.905639:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9618b7c44300) 00010000:00010000:2.0:1788463809.905641:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463809.905645:0:22626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3b77f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.905650:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3b77f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.905714:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961880030800/0x841acb7f42a3b771 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d96 expref: 8 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.905729:0:22626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961880030c00/0x841acb7f42a3b786 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d96 expref: 7 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463809.905737:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9618b7c44200) 00010000:00010000:2.0:1788463809.905739:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788463809.905741:0:22626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961880030c00, rc 0) 00000100:00100000:2.0:1788463809.906207:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+7:18762:x1875339466934144:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 2229us (2710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463809.906219:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 23 00000100:00100000:0.0:1788463809.911882:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463809.911962:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466934272 00000100:00100000:2.0:1788463809.911984:0:22637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466934272 00000100:00100000:2.0:1788463809.912138:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 5 00000100:00100000:2.0:1788463809.912152:0:22637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c8274a4a-4839-4e48-85b1-f0993c4585d3+7:18762:x1875339466934272:12345-192.168.204.53@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788463809.912528:0:22637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c8274a4a-4839-4e48-85b1-f0993c4585d3+7:18762:x1875339466934272:12345-192.168.204.53@tcp:900:lhsmtool_posix.0 Request processed in 377us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463809.912538:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 5 00000100:00100000:0.0:1788463809.920277:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463809.920371:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466934528 00000100:00100000:1.0:1788463809.920383:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466934528 00000100:00100000:1.0:1788463809.920491:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 24 00000100:00100000:1.0:1788463809.920503:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+7:18762:x1875339466934528:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788463809.920529:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463809.920553:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b78d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476d9d expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.920671:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b794 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.920709:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b794 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.920723:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b794 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.922925:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b79b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.922952:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b79b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.922966:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b79b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.923701:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3b7a2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.923715:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3b7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.923726:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3b7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463809.923742:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788463809.923911:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b794 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.923920:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b794 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.923927:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b794 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.923940:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463809.923945:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b794 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.923952:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b794 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.923965:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9618b7c44200) 00010000:00010000:1.0:1788463809.923968:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463809.923984:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b794 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.923991:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b794 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.924012:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b79b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.924018:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b79b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.924024:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b79b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.924029:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463809.924031:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b79b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.924038:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b79b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.924057:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff961884f9dc00) 00010000:00010000:1.0:1788463809.924060:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463809.924063:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b79b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.924069:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b79b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.924901:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b78d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d9d expref: 10 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.924922:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3b7a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d9d expref: 9 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463809.924929:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961884f9d900) 00010000:00010000:1.0:1788463809.924932:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463809.924935:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882812000, rc 0) 00000100:00100000:1.0:1788463809.925020:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+9:18762:x1875339466934528:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 4518us (4754us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788463809.925029:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 24 00000100:00100000:3.0:1788463809.935132:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463809.935788:0:25519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466934656 00000100:00100000:1.0:1788463809.935807:0:25519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466934656 00000100:00100000:1.0:1788463809.935878:0:25519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 25 00000100:00100000:1.0:1788463809.935889:0:25519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+9:18762:x1875339466934656:12345-192.168.204.53@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788463809.936018:0:25519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+9:18762:x1875339466934656:12345-192.168.204.53@tcp:59:lhsmtool_posix.0 Request processed in 131us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463809.936026:0:25519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 25 00000100:00100000:0.0:1788463809.947383:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463809.948437:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466934784 00000100:00100000:2.0:1788463809.948456:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466934784 00000100:00100000:2.0:1788463809.948550:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 26 00000100:00100000:2.0:1788463809.948562:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+5:18762:x1875339466934784:12345-192.168.204.53@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1788463809.962797:0:22627:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 13679us 00000100:00100000:0.0:1788463809.994014:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+5:18762:x1875339466934784:12345-192.168.204.53@tcp:59:lhsmtool_posix.0 Request processed in 45437us (46627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463809.994030:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 26 00000100:00100000:3.0:1788463809.997739:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463810.000463:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466934912 00000100:00100000:2.0:1788463810.000501:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466934912 00000100:00100000:1.0:1788463810.000860:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 27 00000100:00100000:1.0:1788463810.000925:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+9:18768:x1875339466934912:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:1.0:1788463810.000957:0:22626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463810.001004:0:22626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b7b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476da4 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.001122:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b7b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.001150:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b7b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.001165:0:22626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b7b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.001762:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b7be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.001789:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b7be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.001803:0:22626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b7be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.001859:0:22626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b7b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.001867:0:22626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b7b7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.001873:0:22626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b7b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.001895:0:22626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463810.001900:0:22626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b7b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.001908:0:22626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b7b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.001922:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618b7c44900) 00010000:00010000:1.0:1788463810.001925:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463810.001939:0:22626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b7b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.001947:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b7b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.001967:0:22626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b7be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.001985:0:22626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b7be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.001992:0:22626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b7be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.001998:0:22626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463810.002001:0:22626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b7be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.002006:0:22626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b7be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.002024:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff961884f9dc00) 00010000:00010000:1.0:1788463810.002027:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463810.002030:0:22626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b7be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.002035:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b7be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.002092:0:22626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b7b0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476da4 expref: 10 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.002102:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618b7c44900) 00010000:00010000:1.0:1788463810.002104:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463810.002108:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b7b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476da4 expref: 10 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.002118:0:22626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882813200, rc 0) 00000100:00100000:1.0:1788463810.002213:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+9:18768:x1875339466934912:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 1339us (4932us total) trans 0 rc 301/301 00000100:00100000:1.0:1788463810.002222:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 27 00000100:00080000:0.0:1788463810.002344:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463810.017017:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463810.018854:0:22635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466935040 00000100:00100000:2.0:1788463810.018874:0:22635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466935040 00000100:00100000:2.0:1788463810.018956:0:22635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 0 00000100:00100000:2.0:1788463810.018970:0:22635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cfe9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c8274a4a-4839-4e48-85b1-f0993c4585d3+9:18768:x1875339466935040:12345-192.168.204.53@tcp:700:lfs.0 00000100:00100000:2.0:1788463810.019121:0:22635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cfe9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c8274a4a-4839-4e48-85b1-f0993c4585d3+9:18768:x1875339466935040:12345-192.168.204.53@tcp:700:lfs.0 Request processed in 153us (2113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463810.019130:0:22635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 0 00000100:00100000:3.0:1788463810.021532:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463810.021646:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466935296 00000100:00100000:1.0:1788463810.021656:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466935296 00000100:00100000:1.0:1788463810.021717:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 28 00000100:00100000:1.0:1788463810.021727:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cfead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+9:18768:x1875339466935296:12345-192.168.204.53@tcp:36:lfs.0 00010000:00010000:1.0:1788463810.021787:0:22628:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463810.021814:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961880031e00/0x841acb7f42a3b6de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d11 expref: 9 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.021854:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618b7c44900) 00010000:00010000:1.0:1788463810.021860:0:22628:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788463810.021925:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b7c5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.021959:0:22628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b71d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d81 expref: 5 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.021967:0:22628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b7c5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.022010:0:22628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b71d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d81 expref: 5 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.022024:0:22628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b71d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d81 expref: 5 pid: 22628 timeout: 949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463810.022038:0:22628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbef800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22628:1875339485942784:192.168.204.53@tcp:104: 00000100:00100000:1.0:1788463810.022124:0:22628:0:(client.c:2716:ptlrpc_set_wait()) set ffff961788cf2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788463810.033149:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463810.033222:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466935424 00000100:00100000:2.0:1788463810.033232:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466935424 00010000:00010000:2.0:1788463810.033300:0:22611:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b71d lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d81 expref: 6 pid: 22628 timeout: 949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463810.033347:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 15 00000100:00100000:2.0:1788463810.033356:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891629880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57fb5382-3a22-4ad0-a646-5307bf61225a+6:2401:x1875339466935424:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463810.033370:0:22611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463810.033377:0:22611:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b71d lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d81 expref: 6 pid: 22628 timeout: 949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463810.033391:0:22611:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b71d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d81 expref: 6 pid: 22628 timeout: 949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463810.033413:0:22611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618b7c44900) 00010000:00010000:2.0:1788463810.033419:0:22611:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b7c5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463810.033429:0:22611:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b7c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463810.033454:0:22611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b7c5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463810.033473:0:22611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463810.033522:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891629880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57fb5382-3a22-4ad0-a646-5307bf61225a+6:2401:x1875339466935424:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 167us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463810.033530:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 15 00010000:00010000:1.0:1788463810.033892:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b71d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476d81 expref: 5 pid: 22628 timeout: 949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463810.033915:0:22628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbef800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22628:1875339485942784:192.168.204.53@tcp:104: 00010000:00010000:1.0:1788463810.033944:0:22628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b7c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.033954:0:22628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b7c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.033970:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b7c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.034007:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b7cc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.034018:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b7cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.034025:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b7cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788463810.034486:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788463810.037057:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b7d3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.037084:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b7d3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.037095:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b7d3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788463810.037115:0:22628:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a37740f3 reply state 000000007d3d1d08 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b7d3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.037127:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b7d3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.037135:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff961884f9da00) 00010000:00010000:1.0:1788463810.037138:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788463810.037143:0:22628:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788463810.037148:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788463810.037163:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b7c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.037170:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b7c5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.037177:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b7c5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.037184:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463810.037189:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b7c5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.037196:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b7c5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.037207:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618b7c44900) 00010000:00010000:1.0:1788463810.037209:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463810.037213:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b7c5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.037219:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b7c5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788463810.037241:0:22628:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a37740f3 reply state 000000007d3d1d08 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b7cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.037250:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b7cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.037256:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff961884f9dc00) 00010000:00010000:1.0:1788463810.037258:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788463810.037266:0:22628:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788463810.038193:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cfead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+10:18768:x1875339466935296:12345-192.168.204.53@tcp:36:lfs.0 Request processed in 16459us (16662us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788463810.038205:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 28 00000100:00100000:0.0:1788463810.183617:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463810.185100:0:25519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466935552 00000100:00100000:3.0:1788463810.185115:0:25519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466935552 00000100:00100000:3.0:1788463810.185250:0:25519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 29 00000100:00100000:3.0:1788463810.185261:0:25519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+10:18776:x1875339466935552:12345-192.168.204.53@tcp:101:lctl.0 00010000:00010000:3.0:1788463810.185288:0:25519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463810.185311:0:25519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961880030800/0x841acb7f42a3b7da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476dab expref: -99 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463810.185380:0:25519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961880031000/0x841acb7f42a3b7e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463810.185415:0:25519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961880031000/0x841acb7f42a3b7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463810.185429:0:25519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961880031000/0x841acb7f42a3b7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463810.185474:0:25519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788463810.185478:0:25519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788463810.185513:0:25519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961880031000/0x841acb7f42a3b7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463810.185540:0:25519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961880030800/0x841acb7f42a3b7da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476dab expref: 12 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463810.185560:0:25519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961880031000/0x841acb7f42a3b7e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476dab expref: 11 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463810.185569:0:25519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618b7c44c00) 00010000:00010000:3.0:1788463810.185572:0:25519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788463810.185613:0:25519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961880031000, rc 0) 00000100:00100000:3.0:1788463810.185674:0:25519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+11:18776:x1875339466935552:12345-192.168.204.53@tcp:101:lctl.0 Request processed in 415us (2102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463810.185681:0:25519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 29 00000100:00100000:2.0:1788463810.241104:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463810.241211:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466935680 00000100:00100000:0.0:1788463810.241225:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466935680 00000100:00100000:0.0:1788463810.241294:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 30 00000100:00100000:0.0:1788463810.241305:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57fb5382-3a22-4ad0-a646-5307bf61225a+5:18777:x1875339466935680:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:0.0:1788463810.241327:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463810.241352:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b7e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476db2 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.241444:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a3b7ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.241458:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a3b7ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.241472:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a3b7ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463810.241526:0:22627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788463810.241530:0:22627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788463810.241552:0:22627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a3b7ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.241608:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b7e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476db2 expref: 7 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.241628:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a3b7ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476db2 expref: 6 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.241636:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618b7c44c00) 00010000:00010000:0.0:1788463810.241639:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788463810.241643:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f5a00, rc 0) 00000100:00100000:0.0:1788463810.241714:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57fb5382-3a22-4ad0-a646-5307bf61225a+6:18777:x1875339466935680:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 410us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463810.241722:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 30 00000040:00080000:3.0:1788463810.249630:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788463810.252035:0:23381:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788463810.260541:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463810.260694:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466935808 00000100:00100000:1.0:1788463810.260705:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466935808 00000100:00100000:1.0:1788463810.260765:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 31 00000100:00100000:1.0:1788463810.260776:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57fb5382-3a22-4ad0-a646-5307bf61225a+6:18777:x1875339466935808:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:1.0:1788463810.260797:0:22626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463810.260819:0:22626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b7f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476db9 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.260904:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b7fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.260920:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b7fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.260931:0:22626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b7fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.260943:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b804 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.260950:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b804 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.260957:0:22626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b804 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.261037:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a3b80b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.261059:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a3b80b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.261067:0:22626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a3b80b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463810.261110:0:22626:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788463810.261113:0:22626:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788463810.261133:0:22626:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a3b80b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.261146:0:22626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b7fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.261154:0:22626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b7fd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.261161:0:22626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b7fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.261168:0:22626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463810.261173:0:22626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b7fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.261181:0:22626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b7fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.261194:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618b7c44c00) 00010000:00010000:1.0:1788463810.261198:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463810.261203:0:22626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b7fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.261219:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b7fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.261235:0:22626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b804 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.261242:0:22626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b804 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.261247:0:22626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b804 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.261252:0:22626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882812400 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463810.261254:0:22626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b804 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.261261:0:22626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b804 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.261268:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff961884f9dc00) 00010000:00010000:1.0:1788463810.261271:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463810.261274:0:22626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b804 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.261279:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b804 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.261306:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b7f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476db9 expref: 8 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.261331:0:22626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a3b80b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476db9 expref: 7 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.261340:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff961884f9da00) 00010000:00010000:1.0:1788463810.261342:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788463810.261345:0:22626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882813e00, rc 0) 00000100:00100000:1.0:1788463810.261415:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57fb5382-3a22-4ad0-a646-5307bf61225a+7:18777:x1875339466935808:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 641us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463810.261423:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 31 00000100:00100000:2.0:1788463810.278412:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463810.278679:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466935936 00000100:00100000:1.0:1788463810.278689:0:22638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466935936 00000100:00100000:1.0:1788463810.278755:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 6 00000100:00100000:1.0:1788463810.278766:0:22638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:57fb5382-3a22-4ad0-a646-5307bf61225a+5:18777:x1875339466935936:12345-192.168.204.53@tcp:900:lfs.0 00000100:00100000:1.0:1788463810.278864:0:22638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:57fb5382-3a22-4ad0-a646-5307bf61225a+5:18777:x1875339466935936:12345-192.168.204.53@tcp:900:lfs.0 Request processed in 99us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463810.278871:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 6 00000100:00080000:0.0:1788463810.279668:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788463810.294542:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463810.295402:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466936192 00000100:00100000:0.0:1788463810.295418:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466936192 00000100:00100000:0.0:1788463810.295485:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 32 00000100:00100000:0.0:1788463810.295495:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cfeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57fb5382-3a22-4ad0-a646-5307bf61225a+7:18777:x1875339466936192:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:0.0:1788463810.295517:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463810.295540:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b812 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476dc0 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463810.295664:0:22627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788463810.295770:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b812 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476dc0 expref: 9 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.295784:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618b7c44c00) 00010000:00010000:0.0:1788463810.295799:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788463810.295805:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b812 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476dc0 expref: 9 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.295818:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f4200, rc 0) 00000100:00100000:0.0:1788463810.295887:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cfeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57fb5382-3a22-4ad0-a646-5307bf61225a+8:18777:x1875339466936192:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 393us (1359us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1788463810.295895:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 32 00000100:00100000:3.0:1788463810.310474:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463810.310616:0:25519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466936448 00000100:00100000:1.0:1788463810.310626:0:25519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466936448 00000100:00100000:1.0:1788463810.310676:0:25519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 33 00000100:00100000:1.0:1788463810.310685:0:25519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cfeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57fb5382-3a22-4ad0-a646-5307bf61225a+8:18777:x1875339466936448:12345-192.168.204.53@tcp:36:lfs.0 00010000:00010000:1.0:1788463810.310740:0:25519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463810.310763:0:25519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a3b80b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476db9 expref: 8 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.310785:0:25519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff961884f9da00) 00010000:00010000:1.0:1788463810.310802:0:25519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788463810.310823:0:25519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b820 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.310836:0:25519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b820 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.310846:0:25519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b820 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788463810.311041:0:25519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3f302a5 reply state 00000000cada057d transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b820 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.311054:0:25519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b820 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.311060:0:25519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff961884f9da00) 00010000:00010000:1.0:1788463810.311063:0:25519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1788463810.311065:0:25519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788463810.311072:0:25519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788463810.311147:0:25519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cfeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57fb5382-3a22-4ad0-a646-5307bf61225a+9:18777:x1875339466936448:12345-192.168.204.53@tcp:36:lfs.0 Request processed in 463us (682us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1788463810.311155:0:25519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 33 00000100:00100000:3.0:1788463810.312719:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463810.312812:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466936704 00000100:00100000:0.0:1788463810.312821:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466936704 00000100:00100000:0.0:1788463810.312876:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 2 00000100:00100000:0.0:1788463810.312886:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d112d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:57fb5382-3a22-4ad0-a646-5307bf61225a+9:18777:x1875339466936704:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:0.0:1788463810.313094:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d112d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:57fb5382-3a22-4ad0-a646-5307bf61225a+10:18777:x1875339466936704:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 208us (383us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788463810.313114:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 2 00000100:00100000:2.0:1788463810.325114:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463810.325204:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466936960 00000100:00100000:0.0:1788463810.325215:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466936960 00000100:00100000:0.0:1788463810.325370:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 34 00000100:00100000:0.0:1788463810.325381:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57fb5382-3a22-4ad0-a646-5307bf61225a+10:18777:x1875339466936960:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:0.0:1788463810.325403:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463810.325422:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b827 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476dc7 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.325489:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b82e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.325503:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b82e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.325513:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b82e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.325522:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5600/0x841acb7f42a3b835 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.325528:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5600/0x841acb7f42a3b835 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.325534:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5600/0x841acb7f42a3b835 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463810.325687:0:22627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788463810.325771:0:22627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b82e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.325799:0:22627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b82e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.325806:0:22627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b82e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.325812:0:22627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4c00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463810.325816:0:22627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b82e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.325824:0:22627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b82e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.325837:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618b7c44c00) 00010000:00010000:0.0:1788463810.325840:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463810.325845:0:22627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b82e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.325851:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b82e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.325863:0:22627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5600/0x841acb7f42a3b835 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.325869:0:22627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5600/0x841acb7f42a3b835 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.325874:0:22627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5600/0x841acb7f42a3b835 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.325878:0:22627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463810.325886:0:22627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5600/0x841acb7f42a3b835 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.325892:0:22627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5600/0x841acb7f42a3b835 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.325898:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff961884f9dc00) 00010000:00010000:0.0:1788463810.325901:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463810.325903:0:22627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5600/0x841acb7f42a3b835 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.325984:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5600/0x841acb7f42a3b835 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.326020:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b827 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476dc7 expref: 12 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.326030:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618b7c44c00) 00010000:00010000:0.0:1788463810.326032:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788463810.326036:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b827 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476dc7 expref: 12 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463810.326045:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f4200, rc 0) 00000100:00100000:0.0:1788463810.326104:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57fb5382-3a22-4ad0-a646-5307bf61225a+11:18777:x1875339466936960:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 726us (1001us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1788463810.326112:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 34 00000100:00100000:3.0:1788463810.330693:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463810.330897:0:25519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466937088 00000100:00100000:1.0:1788463810.330916:0:25519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466937088 00000100:00100000:1.0:1788463810.330980:0:25519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 35 00000100:00100000:1.0:1788463810.330991:0:25519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d110e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57fb5382-3a22-4ad0-a646-5307bf61225a+11:18777:x1875339466937088:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:1.0:1788463810.331014:0:25519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463810.331036:0:25519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a3b843 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476dce expref: -99 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.331145:0:25519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b84a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.331159:0:25519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b84a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.331170:0:25519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b84a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463810.331193:0:25519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788463810.331197:0:25519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788463810.331213:0:25519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b84a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.331236:0:25519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a3b843 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476dce expref: 13 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.331254:0:25519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b84a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476dce expref: 12 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.331543:0:25519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff961884f9da00) 00010000:00010000:1.0:1788463810.331547:0:25519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788463810.331550:0:25519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882812400, rc 0) 00000100:00100000:1.0:1788463810.331681:0:25519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d110e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57fb5382-3a22-4ad0-a646-5307bf61225a+12:18777:x1875339466937088:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 691us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463810.331688:0:25519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 35 00000100:00100000:3.0:1788463810.338119:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463810.338199:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466937216 00000100:00100000:0.0:1788463810.338210:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466937216 00000100:00100000:0.0:1788463810.338278:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 3 00000100:00100000:0.0:1788463810.338289:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d110a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:57fb5382-3a22-4ad0-a646-5307bf61225a+12:18777:x1875339466937216:12345-192.168.204.53@tcp:37:lfs.0 00000100:00100000:0.0:1788463810.345991:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d110a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:57fb5382-3a22-4ad0-a646-5307bf61225a+12:18777:x1875339466937216:12345-192.168.204.53@tcp:37:lfs.0 Request processed in 7694us (7872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463810.346004:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 3 00000100:00100000:3.0:1788463810.357400:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463810.357625:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466937472 00000100:00100000:2.0:1788463810.357635:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466937472 00000100:00100000:2.0:1788463810.357679:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 4 00000100:00100000:2.0:1788463810.357688:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878c4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:57fb5382-3a22-4ad0-a646-5307bf61225a+12:18777:x1875339466937472:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:2.0:1788463810.357924:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878c4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:57fb5382-3a22-4ad0-a646-5307bf61225a+13:18777:x1875339466937472:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 235us (535us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788463810.357932:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 4 00000100:00100000:3.0:1788463810.435803:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463810.435826:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485942912:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788463810.435898:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463810.435962:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485942912 00000100:00100000:3.0:1788463810.435978:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485942912 00000100:00100000:3.0:1788463810.436022:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788463810.436030:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d112a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485942912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788463810.436061:0:22632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788463810.436099:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d112a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485942912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463810.436121:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788463810.436194:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485942912:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788463810.436398:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788463810.436409:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485943040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463810.436449:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463810.437042:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485943040 00000100:00100000:3.0:1788463810.437049:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485943040 00000100:00100000:3.0:1788463810.437087:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788463810.437095:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485943040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788463810.437128:0:22631:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788463810.437176:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485943040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463810.437182:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788463810.437279:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485943040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788463810.469956:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463810.470076:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466937600 00000100:00100000:1.0:1788463810.470100:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466937600 00000100:00100000:1.0:1788463810.470159:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 36 00000100:00100000:1.0:1788463810.470169:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+11:18783:x1875339466937600:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:1.0:1788463810.470188:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463810.470209:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a3b851 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476dd5 expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.470297:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b858 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.470312:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b858 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.470323:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b858 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.470336:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b85f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.470342:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b85f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.470349:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b85f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.470422:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a3b866 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.470430:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a3b866 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.470437:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a3b866 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463810.470475:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788463810.470479:0:22628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788463810.470526:0:22628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a3b866 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.470539:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b858 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.470544:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b858 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.470550:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b858 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.470556:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463810.470560:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b858 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.470567:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b858 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.470606:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618b7c44c00) 00010000:00010000:1.0:1788463810.470610:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463810.470614:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b858 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.470620:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b858 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.470633:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b85f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.470649:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b85f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.470655:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b85f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.470661:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf400 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463810.470664:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b85f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.470671:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b85f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.470679:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff961884f9dc00) 00010000:00010000:1.0:1788463810.470682:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463810.470685:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b85f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.470692:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b85f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.470720:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a3b851 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476dd5 expref: 13 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.470734:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a3b866 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476dd5 expref: 12 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.470741:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff961884f9da00) 00010000:00010000:1.0:1788463810.470744:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788463810.470752:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdfc00, rc 0) 00000100:00100000:1.0:1788463810.470820:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+12:18783:x1875339466937600:12345-192.168.204.53@tcp:101:bash.0 Request processed in 651us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463810.470827:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 36 00000100:00100000:3.0:1788463810.474942:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463810.475046:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466937728 00000100:00100000:1.0:1788463810.475056:0:22638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466937728 00000100:00100000:1.0:1788463810.475147:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 7 00000100:00100000:1.0:1788463810.475158:0:22638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c8274a4a-4839-4e48-85b1-f0993c4585d3+5:18783:x1875339466937728:12345-192.168.204.53@tcp:900:bash.0 00000100:00100000:1.0:1788463810.475246:0:22638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c8274a4a-4839-4e48-85b1-f0993c4585d3+5:18783:x1875339466937728:12345-192.168.204.53@tcp:900:bash.0 Request processed in 90us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463810.475254:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 7 00000100:00080000:0.0:1788463810.475745:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788463810.480203:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463810.480616:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466937984 00000100:00100000:1.0:1788463810.480626:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466937984 00000100:00100000:1.0:1788463810.480681:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 37 00000100:00100000:1.0:1788463810.480690:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d112d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+12:18783:x1875339466937984:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:1.0:1788463810.480709:0:22626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463810.480727:0:22626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b86d lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476ddc expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.480823:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b874 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.480838:0:22626:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b84a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476dce expref: 12 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.480847:0:22626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b874 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.480896:0:22626:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b84a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476dce expref: 12 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.480909:0:22626:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b84a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476dce expref: 12 pid: 25519 timeout: 949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463810.480923:0:22626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbef800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22626:1875339485943168:192.168.204.53@tcp:104: 00000100:00100000:1.0:1788463810.481547:0:22626:0:(client.c:2716:ptlrpc_set_wait()) set ffff961788cf2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788463810.486243:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463810.486346:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466938112 00000100:00100000:2.0:1788463810.486355:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466938112 00010000:00010000:2.0:1788463810.486394:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b84a lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476dce expref: 13 pid: 25519 timeout: 949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463810.486448:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 16 00000100:00100000:2.0:1788463810.486471:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d110a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57fb5382-3a22-4ad0-a646-5307bf61225a+13:2401:x1875339466938112:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463810.486485:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463810.486492:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b84a lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476dce expref: 13 pid: 25519 timeout: 949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463810.486504:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b84a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476dce expref: 13 pid: 25519 timeout: 949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463810.486525:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff961884f9da00) 00010000:00010000:2.0:1788463810.486530:0:22612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b874 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463810.486539:0:22612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b874 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463810.486546:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b874 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463810.486563:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463810.486640:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d110a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57fb5382-3a22-4ad0-a646-5307bf61225a+13:2401:x1875339466938112:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 171us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463810.486648:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 16 00010000:00010000:1.0:1788463810.488009:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b84a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476dce expref: 12 pid: 25519 timeout: 949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463810.488033:0:22626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbef800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22626:1875339485943168:192.168.204.53@tcp:104: 00010000:00010000:1.0:1788463810.488060:0:22626:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b874 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.488069:0:22626:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b874 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.488076:0:22626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b874 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.488164:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a3b87b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.488178:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a3b87b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.488188:0:22626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a3b87b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.488743:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a3b882 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.488753:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a3b882 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.488761:0:22626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a3b882 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463810.488771:0:22626:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788463810.488795:0:22626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b874 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.488803:0:22626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b874 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.488810:0:22626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b874 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.488815:0:22626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463810.488820:0:22626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b874 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.488827:0:22626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b874 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.488839:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff961884f9da00) 00010000:00010000:1.0:1788463810.488842:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463810.488847:0:22626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b874 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.488864:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b874 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788463810.488875:0:22626:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e52d411d reply state 0000000040b68838 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a3b87b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.488887:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a3b87b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.488894:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff961884f9d300) 00010000:00010000:1.0:1788463810.488897:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788463810.488900:0:22626:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788463810.488934:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b86d lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ddc expref: 15 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.488947:0:22626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a3b882 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ddc expref: 14 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.488953:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:1.0:1788463810.488956:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788463810.488958:0:22626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882813e00, rc 0) 00000100:00100000:1.0:1788463810.489043:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d112d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+15:18783:x1875339466937984:12345-192.168.204.53@tcp:101:bash.0 Request processed in 8353us (8850us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1788463810.489050:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 37 00000100:00100000:3.0:1788463810.507196:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463810.507417:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466938240 00000100:00100000:1.0:1788463810.507437:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466938240 00000100:00100000:1.0:1788463810.507502:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 38 00000100:00100000:1.0:1788463810.507513:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+15:18783:x1875339466938240:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:1.0:1788463810.507543:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463810.507564:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b890 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476de3 expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.507676:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b897 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.507691:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b897 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.507704:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b897 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463810.507751:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788463810.507755:0:22628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788463810.507773:0:22628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b897 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.507784:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b897 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.507808:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b890 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476de3 expref: 17 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.507827:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b897 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476de3 expref: 16 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.507836:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:1.0:1788463810.507839:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463810.507843:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882813600, rc 0) 00000100:00100000:1.0:1788463810.507915:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+16:18783:x1875339466938240:12345-192.168.204.53@tcp:101:bash.0 Request processed in 403us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463810.507922:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 38 00000100:00100000:2.0:1788463810.513400:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463810.513545:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466938496 00000100:00100000:1.0:1788463810.513554:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466938496 00000100:00100000:1.0:1788463810.513657:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 5 00000100:00100000:1.0:1788463810.513668:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+16:18783:x1875339466938496:12345-192.168.204.53@tcp:35:bash.0 00000100:00100000:1.0:1788463810.513957:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+17:18783:x1875339466938496:12345-192.168.204.53@tcp:35:bash.0 Request processed in 290us (567us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1788463810.513976:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 5 00010000:00010000:0.0:1788463810.563755:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463810.657519:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463810.657674:0:25519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466938752 00000100:00100000:1.0:1788463810.657685:0:25519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466938752 00000100:00100000:1.0:1788463810.657752:0:25519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 39 00000100:00100000:1.0:1788463810.657763:0:25519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+17:18793:x1875339466938752:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:1.0:1788463810.657787:0:25519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463810.657809:0:25519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b89e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476dea expref: -99 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463810.657911:0:25519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788463810.658025:0:25519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b89e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476dea expref: 19 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.658040:0:25519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618b7c44c00) 00010000:00010000:1.0:1788463810.658043:0:25519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788463810.658048:0:25519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b89e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476dea expref: 19 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.658080:0:25519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882812400, rc 0) 00000100:00100000:1.0:1788463810.658143:0:25519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+18:18793:x1875339466938752:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 382us (636us total) trans 12884901898 rc 301/301 00000100:00100000:1.0:1788463810.658151:0:25519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 39 00000100:00100000:3.0:1788463810.663924:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463810.664053:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466939008 00000100:00100000:0.0:1788463810.664065:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466939008 00000100:00100000:0.0:1788463810.664143:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 6 00000100:00100000:0.0:1788463810.664156:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+18:18793:x1875339466939008:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:0.0:1788463810.664408:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+19:18793:x1875339466939008:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 253us (494us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1788463810.664416:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 6 00000100:00100000:2.0:1788463810.702474:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463810.702620:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466939264 00000100:00100000:1.0:1788463810.702631:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466939264 00000100:00100000:1.0:1788463810.702689:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 40 00000100:00100000:1.0:1788463810.702698:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+19:18796:x1875339466939264:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:1.0:1788463810.702723:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463810.702743:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b8ac lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476df1 expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.702850:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b8b3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.702864:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b8b3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.702875:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b8b3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463810.702885:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788463810.702995:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b8ac lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476df1 expref: 22 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.703018:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b8b3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476df1 expref: 21 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.703047:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:1.0:1788463810.703049:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463810.703053:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdf400, rc 0) 00000100:00100000:1.0:1788463810.703112:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+21:18796:x1875339466939264:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 415us (653us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1788463810.703119:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 40 00000100:00100000:3.0:1788463810.710404:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463810.710476:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463810.710568:0:25519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466939392 00000100:00100000:1.0:1788463810.710599:0:25519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466939392 00000100:00100000:1.0:1788463810.710665:0:25519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 41 00000100:00100000:1.0:1788463810.710674:0:25519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+21:18796:x1875339466939392:12345-192.168.204.53@tcp:54:lfs.0 00010000:00010000:1.0:1788463810.710740:0:25519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b8c1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.710759:0:25519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b8c1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.710770:0:25519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b8c1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.710804:0:25519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b8c1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.710812:0:25519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b8c1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.710818:0:25519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b8c1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.710822:0:25519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463810.710835:0:25519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b8c1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.710844:0:25519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b8c1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.710855:0:25519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:1.0:1788463810.710858:0:25519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788463810.710862:0:25519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b8c1 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463810.710870:0:25519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b8c1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463810.710954:0:25519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+21:18796:x1875339466939392:12345-192.168.204.53@tcp:54:lfs.0 Request processed in 279us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463810.710972:0:25519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 41 00000100:00100000:2.0:1788463810.711425:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466939520 00000100:00100000:2.0:1788463810.711430:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466939520 00000100:00100000:2.0:1788463810.711473:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 0 00000100:00100000:2.0:1788463810.711480:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+21:2403:x1875339466939520:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463810.711500:0:22611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463810.711516:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b8b3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476df1 expref: 21 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463810.711529:0:22611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:2.0:1788463810.711532:0:22611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463810.711613:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+20:2403:x1875339466939520:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 92us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463810.711621:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 0 00000100:00100000:3.0:1788463810.715339:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463810.716730:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466939776 00000100:00100000:0.0:1788463810.716747:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466939776 00000100:00100000:0.0:1788463810.716842:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 7 00000100:00100000:0.0:1788463810.716853:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+20:18796:x1875339466939776:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:0.0:1788463810.717142:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+21:18796:x1875339466939776:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 291us (1813us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1788463810.717149:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 7 00000100:00100000:0.0:1788463811.150694:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463811.150807:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466940032 00000100:00100000:1.0:1788463811.150819:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466940032 00000100:00100000:1.0:1788463811.150892:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 42 00000100:00100000:1.0:1788463811.150903:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618831f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+21:18827:x1875339466940032:12345-192.168.204.53@tcp:101:cat.0 00010000:00010000:1.0:1788463811.150930:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463811.150964:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b8c8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476df8 expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.151093:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b8cf lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.151109:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b8cf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.151134:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b8cf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463811.151147:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788463811.151513:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b8c8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476df8 expref: 24 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.151533:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b8cf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476df8 expref: 23 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.151543:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:1.0:1788463811.151546:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463811.151550:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdf400, rc 0) 00000100:00100000:1.0:1788463811.151668:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618831f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+23:18827:x1875339466940032:12345-192.168.204.53@tcp:101:cat.0 Request processed in 766us (983us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1788463811.151676:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 42 00000100:00100000:2.0:1788463811.159471:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463811.159525:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463811.159619:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466940416 00000100:00100000:1.0:1788463811.159619:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466940288 00000100:00100000:3.0:1788463811.159629:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466940416 00000100:00100000:1.0:1788463811.159629:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466940288 00000100:00100000:3.0:1788463811.159690:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 1 00000100:00100000:1.0:1788463811.159691:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 8 00000100:00100000:3.0:1788463811.159701:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+24:2401:x1875339466940416:12345-192.168.204.53@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788463811.159701:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+24:18827:x1875339466940288:12345-192.168.204.53@tcp:35:cat.0 00010000:00010000:3.0:1788463811.159717:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463811.159743:0:22612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b8cf lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476df8 expref: 24 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463811.159768:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:3.0:1788463811.159774:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463811.159829:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+23:2401:x1875339466940416:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 129us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463811.159835:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 1 00000100:00100000:1.0:1788463811.159977:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+23:18827:x1875339466940288:12345-192.168.204.53@tcp:35:cat.0 Request processed in 277us (516us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1788463811.159984:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 8 00000100:00100000:3.0:1788463811.271382:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463811.271537:0:25519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466940672 00000100:00100000:1.0:1788463811.271548:0:25519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466940672 00000100:00100000:1.0:1788463811.271654:0:25519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 43 00000100:00100000:1.0:1788463811.271665:0:25519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+23:18833:x1875339466940672:12345-192.168.204.53@tcp:101:dd.0 00010000:00010000:1.0:1788463811.271700:0:25519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463811.271727:0:25519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b8dd lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476dff expref: -99 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.271836:0:25519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b8e4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.271850:0:25519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b8e4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.271861:0:25519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b8e4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463811.271871:0:25519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788463811.272000:0:25519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b8dd lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476dff expref: 26 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.272017:0:25519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b8e4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476dff expref: 25 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.272026:0:25519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:1.0:1788463811.272030:0:25519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463811.272033:0:25519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdf400, rc 0) 00000100:00100000:1.0:1788463811.272093:0:25519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+25:18833:x1875339466940672:12345-192.168.204.53@tcp:101:dd.0 Request processed in 430us (720us total) trans 12884901904 rc 0/0 00000100:00100000:1.0:1788463811.272100:0:25519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 43 00000100:00100000:0.0:1788463811.287206:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463811.287268:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463811.287394:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466940800 00000100:00100000:1.0:1788463811.287407:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466940800 00000100:00100000:1.0:1788463811.287473:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 44 00000100:00100000:1.0:1788463811.287500:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618831f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+25:18833:x1875339466940800:12345-192.168.204.53@tcp:101:dd.0 00010000:00010000:1.0:1788463811.287524:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463811.287545:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b8f2 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476e06 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.287603:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b8f9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.287618:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b8f9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.287630:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b8f9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.287743:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b8f2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e06 expref: 27 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.287763:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b8f9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e06 expref: 26 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.287771:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:1.0:1788463811.287774:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788463811.287778:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882812400, rc 0) 00000100:00100000:1.0:1788463811.287834:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618831f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+26:18833:x1875339466940800:12345-192.168.204.53@tcp:101:dd.0 Request processed in 336us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463811.287841:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 44 00000100:00100000:3.0:1788463811.287906:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466940928 00000100:00100000:3.0:1788463811.287911:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466940928 00000100:00100000:3.0:1788463811.287946:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 2 00000100:00100000:3.0:1788463811.287963:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618831f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+26:2402:x1875339466940928:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463811.287973:0:22611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463811.287986:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b8e4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476dff expref: 26 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463811.288008:0:22611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:3.0:1788463811.288011:0:22611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463811.288034:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618831f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+25:2402:x1875339466940928:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 73us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463811.288039:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 2 00000100:00100000:0.0:1788463811.310507:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463811.310680:0:25519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466941184 00000100:00100000:1.0:1788463811.310690:0:25519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466941184 00000100:00100000:1.0:1788463811.310789:0:25519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 45 00000100:00100000:1.0:1788463811.310810:0:25519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618831f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+25:18833:x1875339466941184:12345-192.168.204.53@tcp:36:dd.0 00010000:00010000:1.0:1788463811.310859:0:25519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463811.310883:0:25519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b897 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476de3 expref: 25 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.310904:0:25519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:1.0:1788463811.310908:0:25519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788463811.311067:0:25519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b900 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.311082:0:25519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b900 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.311091:0:25519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b900 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788463811.311132:0:25519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:1.0:1788463811.311152:0:25519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f77d8cc reply state 00000000fc1de660 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b900 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.311165:0:25519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b900 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.311171:0:25519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:1.0:1788463811.311174:0:25519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788463811.311176:0:25519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788463811.311256:0:25519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618831f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+27:18833:x1875339466941184:12345-192.168.204.53@tcp:36:dd.0 Request processed in 447us (757us total) trans 12884901906 rc 0/0 00000100:00100000:1.0:1788463811.311264:0:25519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 45 00000020:00080000:1.0:1788463811.311268:0:25519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788463811.500067:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463811.500162:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466941440 00000100:00100000:1.0:1788463811.500173:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466941440 00000100:00100000:1.0:1788463811.500230:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 9 00000100:00100000:1.0:1788463811.500241:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618831f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+27:18833:x1875339466941440:12345-192.168.204.53@tcp:35:dd.0 00000100:00100000:1.0:1788463811.500505:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618831f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+28:18833:x1875339466941440:12345-192.168.204.53@tcp:35:dd.0 Request processed in 256us (441us total) trans 12884901907 rc 0/0 00000100:00100000:1.0:1788463811.500512:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 9 00010000:00010000:3.0:1788463811.587775:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463811.815694:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463811.816140:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466941568 00000100:00100000:1.0:1788463811.816152:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466941568 00000100:00100000:1.0:1788463811.816219:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 46 00000100:00100000:1.0:1788463811.816377:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618831f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+28:18847:x1875339466941568:12345-192.168.204.53@tcp:101:stat.0 00010000:00010000:1.0:1788463811.816413:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463811.816435:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b907 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476e0d expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.816502:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b90e lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.816516:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b90e lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.816528:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b90e lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.816539:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3b915 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.816545:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3b915 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.816571:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3b915 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.816671:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c400/0x841acb7f42a3b91c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.816680:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c400/0x841acb7f42a3b91c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.816687:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c400/0x841acb7f42a3b91c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463811.816728:0:22627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788463811.816733:0:22627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788463811.816792:0:22627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c400/0x841acb7f42a3b91c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.816807:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c400/0x841acb7f42a3b91c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.816815:0:22627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b90e lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.816822:0:22627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b90e lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.816829:0:22627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b90e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.816835:0:22627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463811.816839:0:22627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b90e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.816853:0:22627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b90e lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.816865:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff961884f9da00) 00010000:00010000:1.0:1788463811.816868:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463811.816873:0:22627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b90e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.816880:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a3b90e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.816895:0:22627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3b915 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.816901:0:22627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3b915 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.816906:0:22627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3b915 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.816911:0:22627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0c000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463811.816914:0:22627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3b915 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.816920:0:22627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3b915 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.816927:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff961884f9d300) 00010000:00010000:1.0:1788463811.816930:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463811.816933:0:22627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3b915 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.816959:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3b915 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.816988:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3b907 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e0d expref: 30 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.817001:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c400/0x841acb7f42a3b91c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e0d expref: 29 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463811.817009:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:1.0:1788463811.817011:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463811.817013:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0c400, rc 0) 00000100:00100000:1.0:1788463811.817210:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618831f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+29:18847:x1875339466941568:12345-192.168.204.53@tcp:101:stat.0 Request processed in 981us (1526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463811.817218:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 46 00000100:00100000:2.0:1788463811.902373:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463811.902493:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466941824 00000100:00100000:3.0:1788463811.902504:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466941824 00000100:00100000:3.0:1788463811.902567:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 47 00000100:00100000:3.0:1788463811.902608:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+29:18853:x1875339466941824:12345-192.168.204.53@tcp:36:truncate.0 00010000:00010000:3.0:1788463811.902662:0:22626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463811.902690:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c400/0x841acb7f42a3b91c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e0d expref: 29 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463811.902708:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:3.0:1788463811.902713:0:22626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788463811.902885:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3b923 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463811.902900:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3b923 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463811.902910:0:22626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3b923 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788463811.902961:0:22626:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:3.0:1788463811.902986:0:22626:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000649e9956 reply state 000000006ff8ee8e transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3b923 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463811.903008:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3b923 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463811.903013:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:3.0:1788463811.903016:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788463811.903019:0:22626:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788463811.903669:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+31:18853:x1875339466941824:12345-192.168.204.53@tcp:36:truncate.0 Request processed in 1090us (1304us total) trans 12884901909 rc 0/0 00000100:00100000:3.0:1788463811.903677:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 47 00000020:00080000:3.0:1788463811.903683:0:22626:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788463812.109876:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463812.112470:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466941952 00000100:00100000:1.0:1788463812.112485:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466941952 00000100:00100000:1.0:1788463812.112605:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 48 00000100:00100000:1.0:1788463812.112617:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618831f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+31:18867:x1875339466941952:12345-192.168.204.53@tcp:101:stat.0 00010000:00010000:1.0:1788463812.112639:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463812.112658:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3b92a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476e14 expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.112741:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3b931 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.112756:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3b931 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.112772:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3b931 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.112782:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3b938 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.112790:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3b938 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.112796:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3b938 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788463812.113019:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788463812.113090:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d400/0x841acb7f42a3b93f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.113100:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d400/0x841acb7f42a3b93f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.113116:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d400/0x841acb7f42a3b93f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463812.113156:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1788463812.113160:0:22628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788463812.113178:0:22628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d400/0x841acb7f42a3b93f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.113189:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d400/0x841acb7f42a3b93f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.113198:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3b931 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.113217:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3b931 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.113372:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3b931 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.113380:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0dc00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463812.113385:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3b931 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.113402:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3b931 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.113414:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff961884f9da00) 00010000:00010000:1.0:1788463812.113417:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463812.113422:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3b931 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.113427:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3b931 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.113441:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3b938 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.113447:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3b938 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.113453:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3b938 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.113458:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0c600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463812.113465:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3b938 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.113471:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3b938 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.113478:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff961884f9d300) 00010000:00010000:1.0:1788463812.113480:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463812.113483:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3b938 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.113489:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3b938 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.113519:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3b92a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e14 expref: 33 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.113532:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d400/0x841acb7f42a3b93f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e14 expref: 32 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.113539:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:1.0:1788463812.113542:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463812.113544:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0d400, rc 0) 00000100:00100000:1.0:1788463812.114085:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618831f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+32:18867:x1875339466941952:12345-192.168.204.53@tcp:101:stat.0 Request processed in 1467us (4217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463812.114094:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 48 00000100:00100000:0.0:1788463812.281763:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463812.281854:0:25519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466942208 00000100:00100000:1.0:1788463812.281865:0:25519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466942208 00000100:00100000:1.0:1788463812.281938:0:25519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 49 00000100:00100000:1.0:1788463812.281949:0:25519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618831f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+32:18877:x1875339466942208:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:1.0:1788463812.281986:0:25519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463812.282008:0:25519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3b946 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476e1b expref: -99 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463812.282099:0:25519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788463812.282208:0:25519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3b946 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e1b expref: 34 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.282223:0:25519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618b7c44c00) 00010000:00010000:1.0:1788463812.282236:0:25519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788463812.282242:0:25519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3b946 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e1b expref: 34 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.282255:0:25519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0c000, rc 0) 00000100:00100000:1.0:1788463812.282318:0:25519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618831f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+33:18877:x1875339466942208:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 370us (566us total) trans 12884901910 rc 301/301 00000100:00100000:1.0:1788463812.282326:0:25519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 49 00000100:00100000:0.0:1788463812.292314:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463812.292385:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466942464 00000100:00100000:1.0:1788463812.292396:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466942464 00000100:00100000:1.0:1788463812.292455:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 10 00000100:00100000:1.0:1788463812.292465:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878c4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+33:18877:x1875339466942464:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:1.0:1788463812.292723:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878c4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+34:18877:x1875339466942464:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 259us (419us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1788463812.292730:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 10 00000100:00100000:0.0:1788463812.384151:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463812.384984:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466942720 00000100:00100000:2.0:1788463812.384995:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466942720 00000100:00100000:2.0:1788463812.385063:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 50 00000100:00100000:2.0:1788463812.385073:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618831f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+34:18883:x1875339466942720:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:2.0:1788463812.385097:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463812.385119:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26800/0x841acb7f42a3b954 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476e22 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463812.385234:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3b95b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463812.385249:0:22627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a3b882 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ddc expref: 35 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463812.385257:0:22627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d400/0x841acb7f42a3b93f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e14 expref: 35 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463812.385283:0:22627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3b95b lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463812.385317:0:22627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d400/0x841acb7f42a3b93f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e14 expref: 35 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463812.385331:0:22627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d400/0x841acb7f42a3b93f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e14 expref: 35 pid: 22628 timeout: 951 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463812.385345:0:22627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961781de6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22627:1875339485943296:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463812.385539:0:22627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a3b882 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ddc expref: 35 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463812.385549:0:22627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a3b882 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ddc expref: 35 pid: 22626 timeout: 951 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463812.385559:0:22627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961781de5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22627:1875339485943424:192.168.204.53@tcp:104: 00000100:00100000:2.0:1788463812.385618:0:22627:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b7ce9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788463812.393736:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463812.393841:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466942848 00000100:00100000:0.0:1788463812.393851:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466942848 00010000:00010000:0.0:1788463812.393890:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d400/0x841acb7f42a3b93f lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e14 expref: 36 pid: 22628 timeout: 951 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463812.393948:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 17 00000100:00100000:0.0:1788463812.393959:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad1d7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+36:2400:x1875339466942848:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463812.393976:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463812.393983:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d400/0x841acb7f42a3b93f lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e14 expref: 36 pid: 22628 timeout: 951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463812.393997:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d400/0x841acb7f42a3b93f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e14 expref: 36 pid: 22628 timeout: 951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463812.394019:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:0.0:1788463812.394025:0:22612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3b95b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463812.394032:0:22612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3b95b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463812.394039:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463812.394201:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d400/0x841acb7f42a3b93f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e14 expref: 36 pid: 22628 timeout: 951 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463812.394231:0:22627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961781de6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22627:1875339485943296:192.168.204.53@tcp:104: 00000100:00100000:2.0:1788463812.394244:0:22627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961781de5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22627:1875339485943424:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463812.394268:0:22627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3b95b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463812.394370:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad1d7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+35:2400:x1875339466942848:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 412us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463812.394378:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 17 00000100:00100000:1.0:1788463812.406797:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463812.409013:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466942976 00000100:00100000:3.0:1788463812.409028:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466942976 00010000:00010000:3.0:1788463812.409078:0:22611:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a3b882 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ddc expref: 35 pid: 22626 timeout: 951 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463812.409539:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 18 00000100:00100000:3.0:1788463812.409550:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+35:2400:x1875339466942976:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463812.409568:0:22611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463812.409594:0:22611:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a3b882 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ddc expref: 35 pid: 22626 timeout: 951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463812.409607:0:22611:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a3b882 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ddc expref: 35 pid: 22626 timeout: 951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463812.409630:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a3b882 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ddc expref: 35 pid: 22626 timeout: 951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463812.409669:0:22611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:3.0:1788463812.409675:0:22611:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3b95b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463812.409686:0:22611:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3b95b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463812.409694:0:22611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3b95b lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463812.409729:0:22611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463812.409798:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+34:2400:x1875339466942976:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 250us (3016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463812.409806:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 18 00010000:00010000:2.0:1788463812.409871:0:22627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3b95b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463812.409880:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3b95b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463812.409901:0:22627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1788463812.410042:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26800/0x841acb7f42a3b954 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e22 expref: 35 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463812.410058:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3b95b lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e22 expref: 34 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463812.410066:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:2.0:1788463812.410068:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788463812.410070:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e26c00, rc 0) 00000100:00100000:2.0:1788463812.410096:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618831f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+34:18883:x1875339466942720:12345-192.168.204.53@tcp:101:bash.0 Request processed in 25025us (25954us total) trans 12884901912 rc 0/0 00000100:00100000:2.0:1788463812.410103:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 50 00000100:00100000:3.0:1788463812.419819:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463812.419917:0:25519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466943232 00000100:00100000:1.0:1788463812.419951:0:25519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466943232 00000100:00100000:1.0:1788463812.420011:0:25519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 51 00000100:00100000:1.0:1788463812.420020:0:25519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+34:18883:x1875339466943232:12345-192.168.204.53@tcp:36:bash.0 00010000:00010000:1.0:1788463812.420328:0:25519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3b969 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.420347:0:25519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3b969 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.420358:0:25519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3b969 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788463812.420473:0:25519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:1.0:1788463812.420497:0:25519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005dbddee1 reply state 00000000813c888c transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3b969 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.420512:0:25519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3b969 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.420519:0:25519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:1.0:1788463812.420522:0:25519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788463812.420526:0:25519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788463812.420922:0:25519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+37:18883:x1875339466943232:12345-192.168.204.53@tcp:36:bash.0 Request processed in 901us (1111us total) trans 12884901914 rc 0/0 00000100:00100000:1.0:1788463812.420939:0:25519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 51 00000020:00080000:1.0:1788463812.420945:0:25519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788463812.433799:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463812.433879:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466943360 00000100:00100000:1.0:1788463812.433889:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466943360 00000100:00100000:1.0:1788463812.433969:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 52 00000100:00100000:1.0:1788463812.433980:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618831f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+37:18883:x1875339466943360:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:1.0:1788463812.434026:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463812.434049:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3b970 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476e29 expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.434120:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3b970 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e29 expref: 38 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.434136:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3b970 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e29 expref: 38 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.434157:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:1.0:1788463812.434160:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788463812.434165:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0c600, rc 0) 00000100:00100000:1.0:1788463812.434240:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618831f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+38:18883:x1875339466943360:12345-192.168.204.53@tcp:101:bash.0 Request processed in 262us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463812.434248:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 52 00000100:00100000:2.0:1788463812.445450:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463812.445617:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466943488 00000100:00100000:3.0:1788463812.445627:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466943488 00000100:00100000:3.0:1788463812.445690:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 53 00000100:00100000:3.0:1788463812.445699:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+38:18883:x1875339466943488:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:3.0:1788463812.445719:0:22626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463812.445740:0:22626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961880030800/0x841acb7f42a3b977 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476e30 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463812.445828:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b97e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463812.445843:0:22626:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3b95b lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e22 expref: 39 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463812.445870:0:22626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b97e lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463812.445904:0:22626:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3b95b lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e22 expref: 39 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463812.445918:0:22626:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3b95b lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e22 expref: 39 pid: 22627 timeout: 951 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463812.445944:0:22626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188e3e1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22626:1875339485943552:192.168.204.53@tcp:104: 00000100:00100000:3.0:1788463812.446017:0:22626:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618843e23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463812.448553:0:22626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188e3e1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22626:1875339485943552:192.168.204.53@tcp:104: 00010000:00010000:1.0:1788463812.448617:0:22626:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b97e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463812.450679:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463812.450884:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466943616 00000100:00100000:1.0:1788463812.450893:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466943616 00010000:00010000:1.0:1788463812.450945:0:22613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3b95b lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e22 expref: 40 pid: 22627 timeout: 951 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463812.450991:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 19 00000100:00100000:1.0:1788463812.451002:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+40:2400:x1875339466943616:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463812.451034:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463812.451042:0:22613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3b95b lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e22 expref: 40 pid: 22627 timeout: 951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.451056:0:22613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3b95b lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e22 expref: 40 pid: 22627 timeout: 951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.451079:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3b95b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e22 expref: 40 pid: 22627 timeout: 951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.451096:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:1.0:1788463812.451100:0:22613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b97e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.451111:0:22613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b97e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.451118:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b97e lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.451143:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463812.451200:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+39:2400:x1875339466943616:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 199us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463812.451209:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 19 00010000:00010000:3.0:1788463812.451370:0:22626:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b97e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463812.451379:0:22626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b97e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463812.451429:0:22626:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788463812.451434:0:22626:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788463812.451456:0:22626:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b97e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463812.451485:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961880030800/0x841acb7f42a3b977 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e30 expref: 39 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463812.451500:0:22626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b97e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e30 expref: 38 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463812.451520:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:3.0:1788463812.451523:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788463812.451525:0:22626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961880031400, rc 0) 00000100:00100000:3.0:1788463812.451551:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+38:18883:x1875339466943488:12345-192.168.204.53@tcp:101:bash.0 Request processed in 5853us (6112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463812.451558:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 53 00000100:00100000:3.0:1788463812.456193:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463812.456275:0:24967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466943872 00000100:00100000:1.0:1788463812.456285:0:24967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466943872 00000100:00100000:1.0:1788463812.456348:0:24967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 3 00000100:00100000:1.0:1788463812.456359:0:24967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+38:18883:x1875339466943872:12345-192.168.204.53@tcp:103:bash.0 00010000:00010000:1.0:1788463812.456405:0:24967:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788463812.456431:0:24967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3b970 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e29 expref: 38 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.456454:0:24967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b97e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e30 expref: 37 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.456465:0:24967:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:1.0:1788463812.456470:0:24967:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463812.456529:0:24967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+36:18883:x1875339466943872:12345-192.168.204.53@tcp:103:bash.0 Request processed in 173us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463812.456538:0:24967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 3 00000100:00100000:2.0:1788463812.459614:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463812.459719:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466944000 00000100:00100000:1.0:1788463812.459729:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466944000 00000100:00100000:1.0:1788463812.459793:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 54 00000100:00100000:1.0:1788463812.459803:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+36:18883:x1875339466944000:12345-192.168.204.53@tcp:58:bash.0 00010000:00010000:1.0:1788463812.459912:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3b985 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.459941:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3b985 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.459954:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3b985 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788463812.460910:0:22628:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788463812.460954:0:22628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:1.0:1788463812.461080:0:22628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:1.0:1788463812.461188:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+36:18883:x1875339466944000:12345-192.168.204.53@tcp:58:bash.0 Request processed in 1383us (1614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463812.461199:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 54 00000100:00100000:2.0:1788463812.464323:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463812.464405:0:25519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466944128 00000100:00100000:1.0:1788463812.464416:0:25519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466944128 00000100:00100000:1.0:1788463812.464471:0:25519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 55 00000100:00100000:1.0:1788463812.464482:0:25519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+36:18883:x1875339466944128:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:1.0:1788463812.464502:0:25519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463812.464522:0:25519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3b98c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476e37 expref: -99 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.464608:0:25519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3b985 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.464621:0:25519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3b98c lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e37 expref: 37 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.464640:0:25519:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3b985 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.464653:0:25519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3b98c lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e37 expref: 37 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.464667:0:25519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:1.0:1788463812.464670:0:25519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788463812.464674:0:25519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3b98c lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e37 expref: 37 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463812.464683:0:25519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0de00, rc 0) 00000100:00100000:1.0:1788463812.464747:0:25519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+37:18883:x1875339466944128:12345-192.168.204.53@tcp:101:bash.0 Request processed in 267us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463812.464755:0:25519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 55 00010000:00010000:3.0:1788463812.612319:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463812.995996:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961781de4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:abd83a7b-f7e3-4d68-aade-6298a66ab956:3649:1875339485943680:0@lo:400:kworker.0 00000100:00100000:3.0:1788463812.996506:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788463812.996523:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188e3e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485943808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463812.996610:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463812.996658:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485943808 00000100:00100000:3.0:1788463812.996665:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485943808 00000100:00100000:3.0:1788463812.996729:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788463812.996739:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485943808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788463812.996771:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788463812.996813:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485943808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463812.996820:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788463812.996840:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463812.996870:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188e3e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485943808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463812.996931:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188e3e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485943936:0@lo:400:kworker.0 00000100:00100000:3.0:1788463812.996960:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463812.996992:0:23368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485943936 00000100:00100000:3.0:1788463812.996995:0:23368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485943936 00000100:00100000:1.0:1788463812.997963:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485944448:0@lo:400:kworker.0 00000100:00100000:1.0:1788463812.998011:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463812.998421:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485944064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463812.998467:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463812.998499:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485944576:0@lo:400:kworker.0 00000100:00100000:0.0:1788463812.998526:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463812.998545:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485945088:0@lo:400:kworker.0 00000100:00100000:0.0:1788463812.998594:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485944576 00000100:00100000:0.0:1788463812.998600:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485944576 00000100:00100000:0.0:1788463812.998652:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788463812.998661:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618831f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485944576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463812.998708:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618831f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485944576:12345-0@lo:400:kworker.0 Request processed in 48us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463812.998715:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788463812.998736:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485944064 00000100:00100000:0.0:1788463812.998740:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485944064 00000100:00100000:0.0:1788463812.998770:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788463812.998776:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618831f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485944064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788463812.998791:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788463812.998822:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618831f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485944064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463812.998827:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788463812.998845:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788463812.998857:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485944320:0@lo:400:kworker.0 00000100:00100000:0.0:1788463812.998883:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463812.998902:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485944832:0@lo:400:kworker.0 00000100:00100000:0.0:1788463812.998938:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485944320 00000100:00100000:0.0:1788463812.998955:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485944320 00000100:00100000:0.0:1788463812.998981:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788463812.998986:0:24134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618831f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485944320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463812.999387:0:24134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618831f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485944320:12345-0@lo:400:kworker.0 Request processed in 399us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463812.999394:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788463812.999925:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463812.999972:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485944192:0@lo:400:kworker.0 00000100:00100000:2.0:1788463813.000011:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463813.000046:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485944704:0@lo:400:kworker.0 00000100:00100000:2.0:1788463813.000067:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463813.000084:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485945216:0@lo:400:kworker.0 00000100:00100000:2.0:1788463813.000127:0:24581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485944192 00000100:00100000:2.0:1788463813.000132:0:24581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485944192 00000100:00100000:2.0:1788463813.000166:0:24581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485944704 00000100:00100000:2.0:1788463813.000170:0:24581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485944704 00000100:00100000:2.0:1788463813.000187:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788463813.000193:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485944192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463813.000471:0:23368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788463813.000480:0:23368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485943936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463813.000523:0:23368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485943936:12345-0@lo:400:kworker.0 Request processed in 46us (3562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463813.000529:0:23368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788463813.000549:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485944448 00000100:00100000:3.0:1788463813.000552:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485944448 00000100:00100000:3.0:1788463813.000593:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788463813.000600:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485944448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463813.000640:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485944448:12345-0@lo:400:kworker.0 Request processed in 41us (2629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463813.000647:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788463813.000688:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788463813.000695:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485944704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463813.000743:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485944704:12345-0@lo:400:kworker.0 Request processed in 49us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463813.000750:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788463813.000786:0:22621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485943680 00000100:00100000:3.0:1788463813.000790:0:22621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485943680 00000100:00100000:3.0:1788463813.000814:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788463813.000820:0:22621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:3649:x1875339485943680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463813.000853:0:22621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:abd83a7b-f7e3-4d68-aade-6298a66ab956+24:3649:x1875339485943680:12345-0@lo:400:kworker.0 Request processed in 33us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463813.000859:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:3.0:1788463813.000883:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463813.001363:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485944192:12345-0@lo:400:kworker.0 Request processed in 1168us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463813.001371:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788463813.001879:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485944448:0@lo:400:kworker.0 00000100:00100000:1.0:1788463813.001889:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618884f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485944960:0@lo:400:kworker.0 00000100:00100000:1.0:1788463813.001933:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463813.001962:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188e3e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485943936:0@lo:400:kworker.0 00000100:00100000:1.0:1788463813.001996:0:25519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485944960 00000100:00100000:1.0:1788463813.002000:0:25519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485944960 00000100:00100000:3.0:1788463813.002158:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463813.002189:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961781de4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:abd83a7b-f7e3-4d68-aade-6298a66ab956:3649:1875339485943680:0@lo:400:kworker.0 00000100:00100000:3.0:1788463813.002242:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485944192:0@lo:400:kworker.0 00000100:00100000:3.0:1788463813.002254:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485944704:0@lo:400:kworker.0 00000100:00100000:3.0:1788463813.002281:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485945216 00000100:00100000:3.0:1788463813.002285:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485945216 00000100:00100000:3.0:1788463813.002320:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788463813.002329:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485945216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463813.002371:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485945216:12345-0@lo:400:kworker.0 Request processed in 43us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463813.002378:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788463813.002408:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485945216:0@lo:400:kworker.0 00000100:00100000:2.0:1788463813.002732:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463813.002789:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485944064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463813.002805:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485944576:0@lo:400:kworker.0 00000100:00080000:1.0:1788463813.002878:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463813.002909:0:25519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485945088 00000100:00100000:1.0:1788463813.002913:0:25519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485945088 00000100:00080000:1.0:1788463813.002938:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788463813.002958:0:25519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788463813.002965:0:25519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485944960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463813.003003:0:25519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485944960:12345-0@lo:400:kworker.0 Request processed in 40us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463813.003009:0:25519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788463813.003092:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788463813.003101:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485945088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463813.003148:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485945088:12345-0@lo:400:kworker.0 Request processed in 49us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463813.003154:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:2.0:1788463813.003182:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9617884d4a80 x1875339485945088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463813.003192:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485945088:0@lo:400:kworker.0 00000100:00100000:1.0:1788463813.003382:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485944960:0@lo:400:kworker.0 00000100:00100000:0.0:1788463813.003461:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463813.003495:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485945344:0@lo:400:kworker.0 00000100:00100000:0.0:1788463813.003524:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463813.003562:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485944320:0@lo:400:kworker.0 00000100:00100000:3.0:1788463813.003647:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485944832 00000100:00100000:3.0:1788463813.003651:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485944832 00000100:00100000:3.0:1788463813.003684:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485945344 00000100:00100000:3.0:1788463813.003687:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485945344 00000100:00100000:3.0:1788463813.003708:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788463813.003714:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618831f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485944832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463813.003751:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618831f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485944832:12345-0@lo:400:kworker.0 Request processed in 37us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463813.003757:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788463813.003768:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788463813.003774:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618831f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485945344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463813.003800:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618831f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485945344:12345-0@lo:400:kworker.0 Request processed in 26us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463813.003805:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788463813.003871:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618884f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485944832:0@lo:400:kworker.0 00010000:00080000:0.0:1788463813.003882:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9617884d4000 x1875339485945344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463813.003891:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485945344:0@lo:400:kworker.0 00000100:00080000:1.0:1788463813.004003:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1788463813.315920:0:22662:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788463813.315956:0:22662:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788463813.315999:0:22662:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788463813.316017:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788463813.316165:0:22662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188e3e1500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22662:1875339485945472:192.168.204.53@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788463813.316275:0:22662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618843e2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463813.334991:0:22662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188e3e1500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22662:1875339485945472:192.168.204.53@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788463813.335242:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463813.335616:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466944256 00000100:00100000:3.0:1788463813.335624:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466944256 00000100:00100000:3.0:1788463813.335685:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 56 00000100:00100000:3.0:1788463813.335695:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+37:18884:x1875339466944256:12345-192.168.204.53@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788463813.335733:0:22628:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788463813.335871:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+37:18884:x1875339466944256:12345-192.168.204.53@tcp:53:lhsmtool_posix.0 Request processed in 177us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463813.335879:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 56 00000100:00100000:0.0:1788463813.345425:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463813.345521:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466944384 00000100:00100000:3.0:1788463813.345533:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466944384 00000100:00100000:3.0:1788463813.345653:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 57 00000100:00100000:3.0:1788463813.345665:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618831f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+37:18884:x1875339466944384:12345-192.168.204.53@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788463813.345743:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961880030800/0x841acb7f42a3b993 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.345763:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961880030800/0x841acb7f42a3b993 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.345775:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961880030800/0x841acb7f42a3b993 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.345793:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b99a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.345817:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b99a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.345825:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b99a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.345854:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961880031e00/0x841acb7f42a3b9a1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.345877:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961880031e00/0x841acb7f42a3b9a1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.345884:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961880031e00/0x841acb7f42a3b9a1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463813.345942:0:22627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788463813.345947:0:22627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788463813.345963:0:22627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961880031e00/0x841acb7f42a3b9a1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.345975:0:22627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961880030800/0x841acb7f42a3b993 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.345981:0:22627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961880030800/0x841acb7f42a3b993 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.345988:0:22627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961880030800/0x841acb7f42a3b993 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.345994:0:22627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961880030800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463813.345998:0:22627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961880030800/0x841acb7f42a3b993 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.346015:0:22627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961880030800/0x841acb7f42a3b993 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.346028:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961884f9d900) 00010000:00010000:3.0:1788463813.346031:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463813.346036:0:22627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961880030800/0x841acb7f42a3b993 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.346042:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961880030800/0x841acb7f42a3b993 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.346056:0:22627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b99a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.346063:0:22627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b99a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.346069:0:22627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b99a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.346074:0:22627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961880031400 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463813.346077:0:22627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b99a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.346083:0:22627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b99a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.346090:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9618b7c44f00) 00010000:00010000:3.0:1788463813.346092:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463813.346096:0:22627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b99a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.346112:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961880031400/0x841acb7f42a3b99a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.346128:0:22627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961880031e00/0x841acb7f42a3b9a1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.346134:0:22627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961880031e00/0x841acb7f42a3b9a1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.346140:0:22627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961880031e00/0x841acb7f42a3b9a1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.346144:0:22627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961880031e00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463813.346147:0:22627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961880031e00/0x841acb7f42a3b9a1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.346154:0:22627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961880031e00/0x841acb7f42a3b9a1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.346163:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:3.0:1788463813.346165:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463813.346169:0:22627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961880031e00/0x841acb7f42a3b9a1 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.346174:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961880031e00/0x841acb7f42a3b9a1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463813.346261:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618831f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+37:18884:x1875339466944384:12345-192.168.204.53@tcp:34:lhsmtool_posix.0 Request processed in 597us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463813.346269:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 57 00000100:00100000:2.0:1788463813.349060:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463813.349140:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466944640 00000100:00100000:3.0:1788463813.349150:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466944640 00000100:00100000:3.0:1788463813.349211:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 58 00000100:00100000:3.0:1788463813.349221:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+37:18884:x1875339466944640:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788463813.349246:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463813.352316:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874a00/0x841acb7f42a3b9a8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476e3e expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.352443:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9af lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.352459:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9af lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.352471:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9af lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463813.352483:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788463813.352562:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9af lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.352570:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9af lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.352863:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9af lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.352868:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188d874800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463813.352873:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9af lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.352880:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9af lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.353104:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:3.0:1788463813.353108:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788463813.353114:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9af lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.353121:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9af lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.353170:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874a00/0x841acb7f42a3b9a8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e3e expref: 39 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.353180:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961884f9d900) 00010000:00010000:3.0:1788463813.353182:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788463813.353186:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874a00/0x841acb7f42a3b9a8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e3e expref: 39 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.353195:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188d874a00, rc 0) 00000100:00100000:3.0:1788463813.353318:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+38:18884:x1875339466944640:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 4097us (4265us total) trans 12884901915 rc 301/301 00000100:00100000:3.0:1788463813.353328:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 58 00000100:00100000:2.0:1788463813.369424:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463813.376116:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466944768 00000100:00100000:3.0:1788463813.376136:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466944768 00000100:00100000:3.0:1788463813.376228:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 59 00000100:00100000:3.0:1788463813.376238:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+38:18884:x1875339466944768:12345-192.168.204.53@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788463813.376285:0:22627:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788463813.376442:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+38:18884:x1875339466944768:12345-192.168.204.53@tcp:53:lhsmtool_posix.0 Request processed in 204us (7029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463813.376460:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 59 00000100:00100000:0.0:1788463813.382882:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463813.383008:0:25519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466945024 00000100:00100000:1.0:1788463813.383019:0:25519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466945024 00000100:00100000:1.0:1788463813.383082:0:25519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 60 00000100:00100000:1.0:1788463813.383093:0:25519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618831f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+38:18884:x1875339466945024:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788463813.383130:0:25519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463813.383152:0:25519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3b9bd lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476e45 expref: -99 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788463813.383572:0:25519:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x23:0x0], count =31 00000004:00080000:1.0:1788463813.383621:0:25519:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x23:0x0]+31 in llog 00000004:00080000:1.0:1788463813.383645:0:25519:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:1.0:1788463813.383799:0:25519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d200/0x841acb7f42a3b9c4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.383815:0:25519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d200/0x841acb7f42a3b9c4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.383826:0:25519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d200/0x841acb7f42a3b9c4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.383883:0:25519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3b9bd lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e45 expref: 41 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.383901:0:25519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d200/0x841acb7f42a3b9c4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e45 expref: 40 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.383922:0:25519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff961884f9d500) 00010000:00010000:1.0:1788463813.383926:0:25519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463813.383930:0:25519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0d200, rc 0) 00000100:00100000:1.0:1788463813.384002:0:25519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618831f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+40:18884:x1875339466945024:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 910us (1130us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1788463813.384009:0:25519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 60 00000100:00100000:2.0:1788463813.391217:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463813.391399:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466945280 00000100:00100000:3.0:1788463813.391410:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466945280 00000100:00100000:3.0:1788463813.391475:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 61 00000100:00100000:3.0:1788463813.391486:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+40:18884:x1875339466945280:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788463813.391543:0:22627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463813.391617:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d200/0x841acb7f42a3b9c4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e45 expref: 40 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.391637:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff961884f9d500) 00010000:00010000:3.0:1788463813.391646:0:22627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788463813.391670:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874a00/0x841acb7f42a3b9d2 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.391685:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874a00/0x841acb7f42a3b9d2 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.391696:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874a00/0x841acb7f42a3b9d2 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.391732:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9d9 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xa524fbb8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.391740:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9d9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa524fbb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.391748:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9d9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa524fbb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.391817:0:22627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874a00/0x841acb7f42a3b9d2 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.391824:0:22627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874a00/0x841acb7f42a3b9d2 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.391830:0:22627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874a00/0x841acb7f42a3b9d2 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.391836:0:22627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188d874a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463813.391840:0:22627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874a00/0x841acb7f42a3b9d2 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.391848:0:22627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874a00/0x841acb7f42a3b9d2 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.391857:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff961884f9da00) 00010000:00010000:3.0:1788463813.391860:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463813.391864:0:22627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874a00/0x841acb7f42a3b9d2 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.391870:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874a00/0x841acb7f42a3b9d2 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.391880:0:22627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9d9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa524fbb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.391885:0:22627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9d9 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa524fbb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.391890:0:22627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9d9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa524fbb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.391903:0:22627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188d874800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463813.391906:0:22627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9d9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa524fbb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.391923:0:22627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9d9 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa524fbb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.391931:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xa524fbb8 (ffff9618b7c44f00) 00010000:00010000:3.0:1788463813.391933:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463813.391935:0:22627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9d9 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xa524fbb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.391941:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9d9 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xa524fbb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463813.392017:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+39:18884:x1875339466945280:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 Request processed in 532us (819us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788463813.392024:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 61 00000100:00100000:2.0:1788463813.405535:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463813.405664:0:25519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466945408 00000100:00100000:1.0:1788463813.405689:0:25519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466945408 00000100:00100000:1.0:1788463813.405756:0:25519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 62 00000100:00100000:1.0:1788463813.405766:0:25519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+39:18884:x1875339466945408:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788463813.405789:0:25519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463813.405813:0:25519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3b9e0 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476e4c expref: -99 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.405853:0:25519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ca00/0x841acb7f42a3b9e7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.405867:0:25519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ca00/0x841acb7f42a3b9e7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.405880:0:25519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ca00/0x841acb7f42a3b9e7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.406009:0:25519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3b9e0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e4c expref: 41 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.406026:0:25519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ca00/0x841acb7f42a3b9e7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e4c expref: 40 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.406035:0:25519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff961884f9d600) 00010000:00010000:1.0:1788463813.406038:0:25519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788463813.406041:0:25519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0ca00, rc 0) 00000100:00100000:1.0:1788463813.406115:0:25519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+40:18884:x1875339466945408:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 342us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463813.406122:0:25519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 62 00000100:00100000:0.0:1788463813.414239:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463813.414435:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466945664 00000100:00100000:3.0:1788463813.414447:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466945664 00000100:00100000:3.0:1788463813.414510:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 63 00000100:00100000:3.0:1788463813.414520:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618831f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+40:18884:x1875339466945664:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788463813.414660:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9ee lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.414678:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9ee lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.414691:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9ee lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788463813.414879:0:22627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:3.0:1788463813.414889:0:22627:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 852866313366ns, next at 853866310671ns, rc = 0 00000004:00010000:3.0:1788463813.414952:0:22627:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000567e9c66 reply state 000000002dc26dda transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9ee lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.414967:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9ee lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.415317:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff961884f9d600) 00010000:00010000:3.0:1788463813.415321:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788463813.415325:0:22627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788463813.415633:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618831f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+42:18884:x1875339466945664:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 Request processed in 1110us (1399us total) trans 12884901917 rc 0/0 00000100:00100000:2.0:1788463813.415641:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 63 00000100:00100000:2.0:1788463813.422931:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463813.423124:0:25519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466945792 00000100:00100000:1.0:1788463813.423148:0:25519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466945792 00000100:00100000:1.0:1788463813.423222:0:25519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 64 00000100:00100000:1.0:1788463813.423232:0:25519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+42:18884:x1875339466945792:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788463813.423257:0:25519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463813.423278:0:25519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ce00/0x841acb7f42a3b9f5 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476e53 expref: -99 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.423333:0:25519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ce00/0x841acb7f42a3b9f5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e53 expref: 43 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.423347:0:25519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ce00/0x841acb7f42a3b9f5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e53 expref: 43 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.423378:0:25519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff961884f9d600) 00010000:00010000:1.0:1788463813.423382:0:25519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788463813.423386:0:25519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0ce00, rc 0) 00000100:00100000:1.0:1788463813.423449:0:25519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+43:18884:x1875339466945792:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 218us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463813.423456:0:25519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 64 00000100:00100000:1.0:1788463813.428638:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463813.428804:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466945920 00000100:00100000:3.0:1788463813.428815:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466945920 00000100:00100000:3.0:1788463813.428882:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 23 00000100:00100000:3.0:1788463813.428893:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+5:2401:x1875339466945920:12345-192.168.204.53@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788463813.429165:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:2401:x1875339466945920:12345-192.168.204.53@tcp:2:lhsmtool_posix.0 Request processed in 273us (535us total) trans 12884901891 rc 0/0 00000100:00100000:3.0:1788463813.429172:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 23 00000100:00080000:1.0:1788463813.430820:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463813.438466:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463813.438638:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466946176 00000100:00100000:1.0:1788463813.438650:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466946176 00000100:00100000:1.0:1788463813.438715:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 11 00000100:00100000:1.0:1788463813.438727:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618831f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+43:18884:x1875339466946176:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788463813.439021:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618831f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+44:18884:x1875339466946176:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 Request processed in 296us (568us total) trans 12884901918 rc 0/0 00000100:00100000:1.0:1788463813.439040:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 11 00000100:00100000:2.0:1788463813.452234:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463813.453145:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466946432 00000100:00100000:1.0:1788463813.453158:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466946432 00000100:00100000:1.0:1788463813.453234:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 65 00000100:00100000:1.0:1788463813.453245:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+44:18884:x1875339466946432:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788463813.453546:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+44:18884:x1875339466946432:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 Request processed in 302us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463813.453554:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 65 00000100:00100000:2.0:1788463813.465736:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463813.466956:0:25519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466946560 00000100:00100000:1.0:1788463813.466969:0:25519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466946560 00000100:00100000:1.0:1788463813.467145:0:25519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 66 00000100:00100000:1.0:1788463813.467156:0:25519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+44:18884:x1875339466946560:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788463813.467177:0:25519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463813.467198:0:25519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3b9fc lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476e5a expref: -99 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.467328:0:25519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3ba03 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.467343:0:25519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3ba03 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.467354:0:25519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3ba03 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463813.467399:0:25519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788463813.467417:0:25519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3ba03 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.467460:0:25519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3b9fc lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e5a expref: 46 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.467477:0:25519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3ba03 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e5a expref: 45 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.467486:0:25519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff961884f9d600) 00010000:00010000:1.0:1788463813.467489:0:25519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788463813.467493:0:25519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0d600, rc 0) 00000100:00100000:1.0:1788463813.467565:0:25519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+45:18884:x1875339466946560:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 411us (1840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463813.467572:0:25519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 66 00000100:00100000:0.0:1788463813.471139:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463813.471235:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466946688 00000100:00100000:3.0:1788463813.471246:0:24131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466946688 00000100:00100000:3.0:1788463813.471310:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 24 00000100:00100000:3.0:1788463813.471320:0:24131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618831f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+6:2400:x1875339466946688:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788463813.471341:0:24131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463813.471362:0:24131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ceb81e46/0x841acb7f42a3ba0a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476e61 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788463813.471390:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a99cac5, blocks: 0x0 00010000:00010000:3.0:1788463813.471420:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=852s v=(0 0) 00010000:00010000:3.0:1788463813.471425:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463813.471434:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ceb81e46/0x841acb7f42a3ba0a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e61 expref: 7 pid: 24131 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.471457:0:24131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ceb81e46/0x841acb7f42a3ba0a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e61 expref: 7 pid: 24131 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.471484:0:24131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188d874a00, rc 0) 00000100:00100000:3.0:1788463813.471550:0:24131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618831f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+7:2400:x1875339466946688:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 231us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463813.471557:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 24 00000100:00100000:2.0:1788463813.487692:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463813.487803:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466946944 00000100:00100000:1.0:1788463813.487813:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466946944 00000100:00100000:1.0:1788463813.487881:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 67 00000100:00100000:1.0:1788463813.487891:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+45:18884:x1875339466946944:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788463813.488006:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+45:18884:x1875339466946944:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 Request processed in 116us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463813.488014:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 67 00000100:00100000:1.0:1788463813.492953:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463813.493318:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466947072 00000100:00100000:3.0:1788463813.493329:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466947072 00000100:00100000:3.0:1788463813.493397:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 68 00000100:00100000:3.0:1788463813.493409:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+45:18884:x1875339466947072:12345-192.168.204.53@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788463813.498293:0:22605:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:2.0:1788463813.498310:0:22605:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:1.0:1788463813.498453:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b7cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498464:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b7cc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498471:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b7cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498491:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463813.498497:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b7cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498505:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b7cc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498522:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff961884f9dc00) 00010000:00010000:1.0:1788463813.498525:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463813.498529:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b7cc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498536:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813000/0x841acb7f42a3b7cc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498559:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b7d3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498565:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b7d3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498571:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b7d3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498639:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463813.498642:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b7d3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498648:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b7d3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498665:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff961884f9da00) 00010000:00010000:1.0:1788463813.498668:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463813.498671:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b7d3 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498677:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813a00/0x841acb7f42a3b7d3 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498691:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a3b87b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498697:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a3b87b lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498703:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a3b87b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498709:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdfe00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463813.498712:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a3b87b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498719:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a3b87b lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498728:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff961884f9d300) 00010000:00010000:1.0:1788463813.498730:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463813.498733:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a3b87b lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498740:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a3b87b lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498766:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b900 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498773:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b900 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498779:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b900 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498784:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf400 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463813.498788:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b900 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498795:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b900 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498803:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:1.0:1788463813.498806:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463813.498809:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b900 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498815:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a3b900 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498825:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3b923 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498831:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3b923 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498836:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3b923 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498845:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961880030e00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463813.498848:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3b923 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498854:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3b923 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498861:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:1.0:1788463813.498863:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463813.498865:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3b923 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498870:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3b923 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498882:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3b969 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498888:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3b969 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498895:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3b969 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498900:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0c000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463813.498903:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3b969 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498922:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3b969 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498941:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:1.0:1788463813.498944:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463813.498947:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3b969 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498953:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3b969 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498965:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9ee lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498972:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9ee lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498978:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9ee lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498983:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188d874800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463813.498986:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9ee lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498992:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9ee lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.498999:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff961884f9d600) 00010000:00010000:1.0:1788463813.499001:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788463813.499004:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9ee lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.499009:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188d874800/0x841acb7f42a3b9ee lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463813.500421:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961898b25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485945600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788463813.500489:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463813.500569:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485945600 00000100:00100000:3.0:1788463813.500601:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485945600 00000100:00100000:3.0:1788463813.500650:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788463813.500660:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485945600:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788463813.500781:0:24133:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788463813.500784:0:24133:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788463813.500787:0:24133:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788463813.500789:0:24133:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788463813 -> 1788463813 00002000:00010000:3.0:1788463813.500791:0:24133:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000001:00080000:2.0:1788463813.501005:0:22605:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:2.0:1788463813.501063:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b820 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.501073:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b820 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.501080:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b820 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.501086:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463813.501090:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b820 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.501098:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b820 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.501144:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff961884f9da00) 00010000:00010000:2.0:1788463813.501146:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788463813.501151:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b820 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.501166:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3b820 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463813.502600:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1875339485945600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1905us (2073us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788463813.502626:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788463813.502774:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+14:18884:x1875339466947072:12345-192.168.204.53@tcp:44:lhsmtool_posix.0 Request processed in 9366us (9830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463813.502783:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 68 00000100:00100000:3.0:1788463813.508357:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961781de7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485945728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463813.508444:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463813.508933:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485945728 00000100:00100000:2.0:1788463813.508942:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485945728 00000100:00100000:2.0:1788463813.509001:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788463813.509010:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875339485945728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463813.509039:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788463813.509090:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875339485945728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463813.509098:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788463813.509265:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463813.509288:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466947200 00000100:00100000:0.0:1788463813.509292:0:24131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466947200 00000100:00100000:0.0:1788463813.509322:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 26 00000100:00100000:0.0:1788463813.509330:0:24131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+7:2401:x1875339466947200:12345-192.168.204.53@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788463813.509423:0:24131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+7:2401:x1875339466947200:12345-192.168.204.53@tcp:16:lhsmtool_posix.0 Request processed in 94us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463813.509443:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 26 00000100:00100000:3.0:1788463813.510183:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961781de7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485945728:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1788463813.516811:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff961898b25880/2, rc 0, transno 12884901892 00000100:00100000:1.0:1788463813.516827:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961898b25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485945600:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788463813.521032:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463813.521147:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466947456 00000100:00100000:1.0:1788463813.521159:0:22626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466947456 00000100:00100000:1.0:1788463813.521335:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 69 00000100:00100000:1.0:1788463813.521349:0:22626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781de7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+14:18884:x1875339466947456:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788463813.521423:0:22626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463813.521453:0:22626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3ba03 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e5a expref: 14 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.521472:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff961884f9d600) 00010000:00010000:1.0:1788463813.521477:0:22626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788463813.521508:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3ba11 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.521523:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3ba11 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.521532:0:22626:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3ba11 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788463813.521877:0:22626:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036413ae9 reply state 000000005bb98761 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3ba11 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.521892:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c000/0x841acb7f42a3ba11 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22626 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.521926:0:22626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff961884f9d600) 00010000:00010000:1.0:1788463813.521928:0:22626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788463813.521932:0:22626:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788463813.522171:0:22626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781de7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+15:18884:x1875339466947456:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 Request processed in 824us (1146us total) trans 12884901919 rc 0/0 00000100:00100000:1.0:1788463813.522180:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 69 00000100:00100000:1.0:1788463813.527676:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463813.527754:0:24134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466947584 00000100:00100000:2.0:1788463813.527765:0:24134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466947584 00000100:00100000:2.0:1788463813.527821:0:24134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 27 00000100:00100000:2.0:1788463813.527831:0:24134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+7:18884:x1875339466947584:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788463813.527848:0:24134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463813.527866:0:24134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001a20bf4/0x841acb7f42a3ba18 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476e68 expref: -99 pid: 24134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.527897:0:24134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ceb81e46/0x841acb7f42a3ba0a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e61 expref: 8 pid: 24131 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.527935:0:24134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463813.527940:0:24134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463813.527946:0:24134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001a20bf4/0x841acb7f42a3ba18 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e68 expref: 8 pid: 24134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.527980:0:24134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ceb81e46/0x841acb7f42a3ba0a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e61 expref: 8 pid: 24131 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.527992:0:24134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ceb81e46/0x841acb7f42a3ba0a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e61 expref: 8 pid: 24131 timeout: 952 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463813.528007:0:24134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24134:1875339485945856:192.168.204.53@tcp:104: 00000100:00100000:2.0:1788463813.528104:0:24134:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b7ce9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788463813.536839:0:24134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24134:1875339485945856:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463813.536895:0:24134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000001a20bf4/0x841acb7f42a3ba18 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e68 expref: 8 pid: 24134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.536929:0:24134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e27200, rc 0) 00000100:00100000:2.0:1788463813.536994:0:24134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+8:18884:x1875339466947584:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 9163us (9328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463813.537004:0:24134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 27 00000100:00100000:0.0:1788463813.537277:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463813.538497:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466947712 00000100:00100000:2.0:1788463813.538509:0:22613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466947712 00010000:00010000:2.0:1788463813.538567:0:22613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ceb81e46/0x841acb7f42a3ba0a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e61 expref: 8 pid: 24131 timeout: 952 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463813.538654:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 20 00000100:00100000:2.0:1788463813.538664:0:22613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d110a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+8:2401:x1875339466947712:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463813.538684:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463813.538707:0:22613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ceb81e46/0x841acb7f42a3ba0a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e61 expref: 8 pid: 24131 timeout: 952 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.538720:0:22613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ceb81e46/0x841acb7f42a3ba0a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e61 expref: 8 pid: 24131 timeout: 952 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.538743:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ceb81e46/0x841acb7f42a3ba0a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e61 expref: 8 pid: 24131 timeout: 952 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.538761:0:22613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463813.538765:0:22613:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463813.538773:0:22613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001a20bf4/0x841acb7f42a3ba18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e68 expref: 7 pid: 24134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.538784:0:22613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001a20bf4/0x841acb7f42a3ba18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e68 expref: 7 pid: 24134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.538823:0:22613:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000001a20bf4/0x841acb7f42a3ba18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e68 expref: 7 pid: 24134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463813.538854:0:22613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:22613:1875339485945984:192.168.204.53@tcp:105: 00000100:00100000:2.0:1788463813.538954:0:22613:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b7ce9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788463813.546091:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463813.546313:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466947840 00000100:00100000:3.0:1788463813.546323:0:24131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466947840 00000100:00100000:3.0:1788463813.546402:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 28 00000100:00100000:3.0:1788463813.546414:0:24131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+8:2400:x1875339466947840:12345-192.168.204.53@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788463813.546686:0:24131:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788463813.546690:0:24131:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788463812 00002000:00010000:3.0:1788463813.546693:0:24131:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788463810 00002000:00010000:3.0:1788463813.546695:0:24131:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788463813 -> 1788463812 00002000:00010000:3.0:1788463813.546698:0:24131:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788463813.546759:0:24131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+9:2400:x1875339466947840:12345-192.168.204.53@tcp:2:lhsmtool_posix.0 Request processed in 347us (681us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788463813.546767:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 28 00000100:00100000:2.0:1788463813.547775:0:22613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:22613:1875339485945984:192.168.204.53@tcp:105: 00010000:00010000:2.0:1788463813.547806:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463813.547861:0:22613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d110a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+8:2401:x1875339466947712:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 9197us (10584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463813.547871:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 20 00000100:00100000:3.0:1788463813.555694:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463813.556204:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466947968 00000100:00100000:2.0:1788463813.556218:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466947968 00000100:00100000:2.0:1788463813.556354:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 29 00000100:00100000:2.0:1788463813.556365:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+8:2402:x1875339466947968:12345-192.168.204.53@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788463813.556416:0:24133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d8530314/0x841acb7f42a3ba1f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.556436:0:24133:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000001a20bf4/0x841acb7f42a3ba18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e68 expref: 8 pid: 24134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.556444:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788463813.556448:0:24133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788463813.556454:0:24133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8530314/0x841acb7f42a3ba1f lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.556492:0:24133:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000001a20bf4/0x841acb7f42a3ba18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e68 expref: 8 pid: 24134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.556527:0:24133:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000001a20bf4/0x841acb7f42a3ba18 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e68 expref: 8 pid: 24134 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463813.556541:0:24133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24133:1875339485946112:192.168.204.53@tcp:104: 00000100:00100000:2.0:1788463813.556723:0:24133:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b7ce9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788463813.563202:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463813.563266:0:24967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466948096 00000100:00100000:3.0:1788463813.563276:0:24967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466948096 00010000:00010000:3.0:1788463813.563317:0:24967:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000001a20bf4/0x841acb7f42a3ba18 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e68 expref: 9 pid: 24134 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463813.563390:0:24133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24133:1875339485946112:192.168.204.53@tcp:104: 00000100:00100000:3.0:1788463813.563398:0:24967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 21 00000100:00100000:3.0:1788463813.563406:0:24967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+9:2400:x1875339466948096:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463813.563417:0:24133:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d8530314/0x841acb7f42a3ba1f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.563420:0:24967:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463813.563441:0:24967:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000001a20bf4/0x841acb7f42a3ba18 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e68 expref: 9 pid: 24134 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.563455:0:24967:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000001a20bf4/0x841acb7f42a3ba18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e68 expref: 9 pid: 24134 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.563480:0:24967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001a20bf4/0x841acb7f42a3ba18 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e68 expref: 9 pid: 24134 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.563494:0:24967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788463813.563498:0:24967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788463813.563504:0:24967:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8530314/0x841acb7f42a3ba1f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.563515:0:24967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8530314/0x841acb7f42a3ba1f lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.563546:0:24967:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463813.563715:0:24967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+8:2400:x1875339466948096:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 307us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463813.563724:0:24967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 21 00010000:00010000:2.0:1788463813.563789:0:24133:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d8530314/0x841acb7f42a3ba1f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.563798:0:24133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8530314/0x841acb7f42a3ba1f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.563820:0:24133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d8530314/0x841acb7f42a3ba1f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.563828:0:24133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8530314/0x841acb7f42a3ba1f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.563836:0:24133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8530314/0x841acb7f42a3ba1f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.564082:0:24133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e27c00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:2.0:1788463813.564086:0:24133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8530314/0x841acb7f42a3ba1f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.564096:0:24133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8530314/0x841acb7f42a3ba1f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.564339:0:24133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8530314/0x841acb7f42a3ba1f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.564349:0:24133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8530314/0x841acb7f42a3ba1f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463813.564469:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+7:2402:x1875339466947968:12345-192.168.204.53@tcp:1:lhsmtool_posix.0 Request processed in 8105us (8784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463813.564478:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 29 00000100:00100000:1.0:1788463813.567994:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463813.568079:0:25519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466948352 00000100:00100000:0.0:1788463813.568090:0:25519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466948352 00000100:00100000:0.0:1788463813.568168:0:25519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 70 00000100:00100000:0.0:1788463813.568179:0:25519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+15:18884:x1875339466948352:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788463813.568276:0:25519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3ba26 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463813.568295:0:25519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b8f9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e06 expref: 15 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463813.568306:0:25519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3ba26 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463813.568341:0:25519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b8f9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e06 expref: 15 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463813.568357:0:25519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b8f9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e06 expref: 15 pid: 22627 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463813.568371:0:25519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188e3cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25519:1875339485946240:192.168.204.53@tcp:104: 00000100:00100000:0.0:1788463813.568451:0:25519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618812ed600 going to sleep for 11 seconds 00000100:00100000:0.0:1788463813.574960:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463813.575044:0:22612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466948480 00000100:00100000:3.0:1788463813.575053:0:22612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466948480 00010000:00010000:3.0:1788463813.575091:0:22612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b8f9 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e06 expref: 16 pid: 22627 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463813.575141:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 22 00000100:00100000:3.0:1788463813.575151:0:22612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+16:2400:x1875339466948480:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463813.575176:0:22612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463813.575183:0:22612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b8f9 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e06 expref: 16 pid: 22627 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.575206:0:22612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b8f9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e06 expref: 16 pid: 22627 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.575230:0:22612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:3.0:1788463813.575237:0:22612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3b98c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e37 expref: 16 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.575247:0:22612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3ba26 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.575254:0:22612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3ba26 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.575261:0:22612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3ba26 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.575280:0:22612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463813.575343:0:22612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+16:2400:x1875339466948480:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 193us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463813.575364:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 22 00010000:00010000:1.0:1788463813.576485:0:25519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3b8f9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e06 expref: 15 pid: 22627 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463813.576509:0:25519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188e3cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25519:1875339485946240:192.168.204.53@tcp:104: 00010000:00010000:1.0:1788463813.576539:0:25519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3ba26 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.576549:0:25519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3ba26 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.576555:0:25519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3ba26 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.577081:0:25519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27c00/0x841acb7f42a3ba2d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.577097:0:25519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ce00/0x841acb7f42a3b9f5 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e53 expref: 15 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.577117:0:25519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27c00/0x841acb7f42a3ba2d lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.577164:0:25519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ce00/0x841acb7f42a3b9f5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e53 expref: 15 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.577190:0:25519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ce00/0x841acb7f42a3b9f5 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e53 expref: 15 pid: 25519 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463813.577214:0:25519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25519:1875339485946368:192.168.204.53@tcp:104: 00000100:00100000:2.0:1788463813.577301:0:25519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b7ce90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463813.581967:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463813.582205:0:25519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25519:1875339485946368:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463813.582239:0:25519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27c00/0x841acb7f42a3ba2d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463813.582446:0:22611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466948608 00000100:00100000:3.0:1788463813.582454:0:22611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466948608 00010000:00010000:3.0:1788463813.582498:0:22611:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ce00/0x841acb7f42a3b9f5 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e53 expref: 16 pid: 25519 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463813.582668:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 23 00000100:00100000:3.0:1788463813.582679:0:22611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad1d4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+16:2401:x1875339466948608:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463813.582694:0:22611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463813.582701:0:22611:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ce00/0x841acb7f42a3b9f5 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e53 expref: 16 pid: 25519 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.582712:0:22611:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ce00/0x841acb7f42a3b9f5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e53 expref: 16 pid: 25519 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.582733:0:22611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ce00/0x841acb7f42a3b9f5 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e53 expref: 16 pid: 25519 timeout: 953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.582747:0:22611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff961884f9d600) 00010000:00010000:3.0:1788463813.582752:0:22611:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27c00/0x841acb7f42a3ba2d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.582762:0:22611:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27c00/0x841acb7f42a3ba2d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.582768:0:22611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27c00/0x841acb7f42a3ba2d lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.582809:0:22611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463813.582856:0:22611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad1d4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+15:2401:x1875339466948608:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 179us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463813.582865:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 23 00010000:00010000:2.0:1788463813.582968:0:25519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27c00/0x841acb7f42a3ba2d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.582976:0:25519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27c00/0x841acb7f42a3ba2d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788463813.583083:0:25519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:2.0:1788463813.583224:0:25519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:2.0:1788463813.583262:0:25519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:2.0:1788463813.583343:0:25519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618ad76b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:25519:1875339485946496:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788463813.583392:0:25519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463813.583428:0:25519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b7ce9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788463813.583430:0:23368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485946496 00000100:00100000:1.0:1788463813.583436:0:23368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485946496 00000100:00100000:1.0:1788463813.583476:0:23368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788463813.583484:0:23368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:25519:x1875339485946496:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788463813.583557:0:23368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:25519:x1875339485946496:12345-0@lo:1000:mdt00_003.0 Request processed in 74us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463813.583591:0:23368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788463813.584426:0:25519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618ad76b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:25519:1875339485946496:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788463813.584854:0:25519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:2.0:1788463813.584931:0:25519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf55e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:25519:1875339485946624:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788463813.584977:0:25519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463813.585006:0:25519:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c06d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463813.585461:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485946624 00000100:00100000:3.0:1788463813.585470:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485946624 00000100:00100000:3.0:1788463813.585525:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788463813.585540:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf55e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:25519:x1875339485946624:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788463813.585998:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf55e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:25519:x1875339485946624:12345-0@lo:1000:mdt00_003.0 Request processed in 463us (1019us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1788463813.586007:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788463813.586244:0:25519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf55e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:25519:1875339485946624:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788463813.586299:0:25519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27c00/0x841acb7f42a3ba2d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463813.586309:0:25519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27c00/0x841acb7f42a3ba2d lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463813.586316:0:25519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27c00/0x841acb7f42a3ba2d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463813.586322:0:25519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e27c00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463813.586327:0:25519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27c00/0x841acb7f42a3ba2d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463813.586336:0:25519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27c00/0x841acb7f42a3ba2d lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463813.586353:0:25519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff961884f9d600) 00010000:00010000:0.0:1788463813.586356:0:25519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788463813.586361:0:25519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27c00/0x841acb7f42a3ba2d lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463813.586690:0:25519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27c00/0x841acb7f42a3ba2d lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463813.586728:0:25519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3b985 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463813.586736:0:25519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3b985 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463813.586742:0:25519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3b985 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463813.586758:0:25519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0dc00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463813.586762:0:25519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3b985 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463813.586769:0:25519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3b985 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463813.586778:0:25519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:0.0:1788463813.586781:0:25519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788463813.586788:0:25519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3b98c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e37 expref: 18 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463813.586800:0:25519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3b98c lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e37 expref: 18 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463813.586810:0:25519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3b98c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e37 expref: 18 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463813.586870:0:25519:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3b98c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e37 expref: 18 pid: 25519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463813.586884:0:25519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188e3cfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25519:1875339485946752:192.168.204.53@tcp:105: 00000100:00100000:0.0:1788463813.586974:0:25519:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787095000 going to sleep for 11 seconds 00000100:00100000:2.0:1788463813.590649:0:25519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188e3cfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25519:1875339485946752:192.168.204.53@tcp:105: 00010000:00010000:2.0:1788463813.590686:0:25519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3b985 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.590696:0:25519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3b985 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.590732:0:25519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3ba34 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.590746:0:25519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3ba34 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.590757:0:25519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3ba34 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.590767:0:25519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3ba34 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.590773:0:25519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3ba34 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.590779:0:25519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3ba34 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.590785:0:25519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e27000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463813.590789:0:25519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3ba34 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.591153:0:25519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3ba34 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.591169:0:25519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:2.0:1788463813.591172:0:25519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463813.591176:0:25519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3ba34 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.591181:0:25519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3ba34 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.591193:0:25519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3ba26 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.591258:0:25519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3ba26 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.591264:0:25519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3ba26 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.591269:0:25519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463813.591272:0:25519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3ba26 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.591277:0:25519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3ba26 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.591285:0:25519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:2.0:1788463813.591287:0:25519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788463813.591290:0:25519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3ba26 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.591307:0:25519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3ba26 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463813.591548:0:25519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8274a4a-4839-4e48-85b1-f0993c4585d3+18:18884:x1875339466948352:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 Request processed in 23368us (23561us total) trans 12884901924 rc 0/0 00000100:00100000:2.0:1788463813.591558:0:25519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 70 00000020:00080000:2.0:1788463813.591564:0:25519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788463813.594201:0:22662:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788463813.594209:0:22662:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788463813.594228:0:22662:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788463813.594235:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788463813.594831:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463813.594913:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466948736 00000100:00100000:2.0:1788463813.594923:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466948736 00000100:00100000:2.0:1788463813.594974:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 12 00000100:00100000:2.0:1788463813.594984:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+18:18883:x1875339466948736:12345-192.168.204.53@tcp:49:bash.0 00000100:00100000:2.0:1788463813.595117:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+18:18883:x1875339466948736:12345-192.168.204.53@tcp:49:bash.0 Request processed in 134us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463813.595124:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 12 00000100:00100000:0.0:1788463813.596291:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463813.596447:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466948992 00000100:00100000:2.0:1788463813.596454:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466948992 00000100:00100000:2.0:1788463813.596497:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 13 00000100:00100000:2.0:1788463813.596507:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+18:18884:x1875339466948992:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788463813.596808:0:22630:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788463813.596840:0:22630:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:2.0:1788463813.596874:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3ba3b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.596890:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3ba3b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.596901:0:22630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3ba3b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.596929:0:22630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3ba3b lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.596936:0:22630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3ba3b lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.596942:0:22630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3ba3b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.596958:0:22630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788463813.597039:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+20:18884:x1875339466948992:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 Request processed in 532us (758us total) trans 12884901926 rc 0/0 00000100:00100000:2.0:1788463813.597047:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 13 00000020:00080000:2.0:1788463813.597052:0:22630:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788463813.597230:0:22615:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463813.597236:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3ba3b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.597244:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e27a00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463813.597249:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3ba3b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.597257:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3ba3b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.597271:0:22615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff961884f9d600) 00010000:00010000:1.0:1788463813.597274:0:22615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788463813.597285:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3ba3b lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.597292:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3ba3b lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463813.597308:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463813.597311:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463813.597312:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463813.602498:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463813.602614:0:24131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466949120 00000100:00100000:3.0:1788463813.602624:0:24131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466949120 00000100:00100000:3.0:1788463813.602679:0:24131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 30 00000100:00100000:3.0:1788463813.602689:0:24131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+7:18883:x1875339466949120:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:3.0:1788463813.602707:0:24131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463813.602727:0:24131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9b429fe/0x841acb7f42a3ba42 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476e6f expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788463813.602755:0:24131:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a99cac4, atime: 0x6a99cac2, ctime: 0x6a99cac4, blocks: 0x0 00010000:00010000:3.0:1788463813.602777:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=853s v=(0 0) 00010000:00010000:3.0:1788463813.602783:0:24131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463813.602794:0:24131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9b429fe/0x841acb7f42a3ba42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e6f expref: 8 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.602831:0:24131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b9b429fe/0x841acb7f42a3ba42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e6f expref: 8 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.602845:0:24131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188d875600, rc 0) 00000100:00100000:3.0:1788463813.603032:0:24131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+8:18883:x1875339466949120:12345-192.168.204.53@tcp:101:bash.0 Request processed in 343us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463813.603040:0:24131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 30 00000100:00100000:3.0:1788463813.610152:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463813.610309:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466949248 00000100:00100000:2.0:1788463813.610320:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466949248 00000100:00100000:2.0:1788463813.610393:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 71 00000100:00100000:2.0:1788463813.610404:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+20:18883:x1875339466949248:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:2.0:1788463813.610428:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463813.610449:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3ba49 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476e76 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.610482:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27400/0x841acb7f42a3ba50 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.610495:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27400/0x841acb7f42a3ba50 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.610506:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27400/0x841acb7f42a3ba50 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.610665:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3ba49 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e76 expref: 22 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.610685:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27400/0x841acb7f42a3ba50 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e76 expref: 21 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.610693:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:2.0:1788463813.610696:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788463813.610700:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e27400, rc 0) 00000100:00100000:2.0:1788463813.610758:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+21:18883:x1875339466949248:12345-192.168.204.53@tcp:101:bash.0 Request processed in 356us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463813.610766:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 71 00000100:00100000:0.0:1788463813.615264:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463813.617402:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466949504 00000100:00100000:2.0:1788463813.617416:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466949504 00000100:00100000:2.0:1788463813.617474:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 14 00000100:00100000:2.0:1788463813.617484:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+21:18883:x1875339466949504:12345-192.168.204.53@tcp:35:bash.0 00000001:00080000:2.0:1788463813.617805:0:22630:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:2.0:1788463813.618095:0:22630:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:2.0:1788463813.618227:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+24:18883:x1875339466949504:12345-192.168.204.53@tcp:35:bash.0 Request processed in 742us (2972us total) trans 12884901929 rc 0/0 00000100:00100000:2.0:1788463813.618236:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 14 00000020:00080000:2.0:1788463813.618241:0:22630:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788463813.635782:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463813.726338:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463813.726436:0:22628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466949760 00000100:00100000:3.0:1788463813.726446:0:22628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466949760 00000100:00100000:3.0:1788463813.726518:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 72 00000100:00100000:3.0:1788463813.726528:0:22628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+24:18894:x1875339466949760:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:3.0:1788463813.726554:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463813.726621:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188d875e00/0x841acb7f42a3ba57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476e7d expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463813.726725:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788463813.726828:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96188d875e00/0x841acb7f42a3ba57 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e7d expref: 26 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.726842:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618b7c44c00) 00010000:00010000:3.0:1788463813.726846:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788463813.726851:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188d875e00/0x841acb7f42a3ba57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476e7d expref: 26 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463813.726884:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188d875e00, rc 0) 00000100:00100000:3.0:1788463813.726962:0:22628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8274a4a-4839-4e48-85b1-f0993c4585d3+25:18894:x1875339466949760:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 434us (638us total) trans 12884901930 rc 301/301 00000100:00100000:3.0:1788463813.726969:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 72 00000100:00100000:3.0:1788463813.733136:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463813.733243:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466949888 00000100:00100000:2.0:1788463813.733253:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466949888 00000100:00100000:2.0:1788463813.733315:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 73 00000100:00100000:2.0:1788463813.733325:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+25:18894:x1875339466949888:12345-192.168.204.53@tcp:34:lfs.0 00010000:00010000:2.0:1788463813.733434:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3ba65 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733451:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3ba65 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733463:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3ba65 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733477:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3ba6c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733484:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3ba6c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733490:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3ba6c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733568:0:22627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27e00/0x841acb7f42a3ba73 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733599:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27e00/0x841acb7f42a3ba73 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733607:0:22627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27e00/0x841acb7f42a3ba73 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788463813.733651:0:22627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27e00/0x841acb7f42a3ba73 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733665:0:22627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3ba65 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733682:0:22627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3ba65 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733690:0:22627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3ba65 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733697:0:22627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e27000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463813.733703:0:22627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3ba65 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733711:0:22627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3ba65 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733725:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff961884f9da00) 00010000:00010000:2.0:1788463813.733728:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463813.733733:0:22627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3ba65 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733739:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3ba65 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733751:0:22627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3ba6c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733757:0:22627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3ba6c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733763:0:22627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3ba6c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733767:0:22627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26c00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463813.733776:0:22627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3ba6c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733784:0:22627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3ba6c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733791:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff961894655d00) 00010000:00010000:2.0:1788463813.733794:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463813.733797:0:22627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3ba6c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733803:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3ba6c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733818:0:22627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27e00/0x841acb7f42a3ba73 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733825:0:22627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27e00/0x841acb7f42a3ba73 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733831:0:22627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27e00/0x841acb7f42a3ba73 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733836:0:22627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e27e00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463813.733839:0:22627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27e00/0x841acb7f42a3ba73 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733845:0:22627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27e00/0x841acb7f42a3ba73 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733852:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff961884f9d000) 00010000:00010000:2.0:1788463813.733854:0:22627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463813.733862:0:22627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27e00/0x841acb7f42a3ba73 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463813.733869:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27e00/0x841acb7f42a3ba73 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463813.733959:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+25:18894:x1875339466949888:12345-192.168.204.53@tcp:34:lfs.0 Request processed in 634us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463813.733968:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 73 00000100:00100000:0.0:1788463813.737527:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463813.737975:0:22629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466950144 00000100:00100000:2.0:1788463813.737986:0:22629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466950144 00000100:00100000:2.0:1788463813.738050:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 15 00000100:00100000:2.0:1788463813.738060:0:22629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+25:18894:x1875339466950144:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:2.0:1788463813.738314:0:22629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+26:18894:x1875339466950144:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 254us (796us total) trans 12884901931 rc 0/0 00000100:00100000:2.0:1788463813.738322:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 15 00000100:00100000:0.0:1788463813.870313:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463813.870362:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463813.870398:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463813.870424:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463813.870448:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463813.870491:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466950272 00000100:00100000:0.0:1788463813.870503:0:22620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466950272 00000100:00100000:0.0:1788463813.870553:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 169 00000100:00100000:0.0:1788463813.870563:0:22620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf4d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+13:2400:x1875339466950272:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463813.870668:0:22620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf4d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b1eb07-ba00-4022-83ff-1e9ef0c58e30+13:2400:x1875339466950272:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 106us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463813.870677:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 169 00000100:00100000:0.0:1788463813.870727:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463813.870832:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463813.870850:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463813.870870:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463813.871093:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466950656 00000100:00100000:2.0:1788463813.871098:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466950656 00000100:00100000:2.0:1788463813.871125:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466951168 00000100:00100000:2.0:1788463813.871128:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466951168 00000100:00100000:2.0:1788463813.871162:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466950784 00000100:00100000:2.0:1788463813.871168:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466950784 00000100:00100000:2.0:1788463813.871181:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466951296 00000100:00100000:2.0:1788463813.871183:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466951296 00000100:00100000:2.0:1788463813.871211:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 31 00000100:00100000:2.0:1788463813.871218:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+8:2400:x1875339466950656:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463813.871258:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+8:2400:x1875339466950656:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 41us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463813.871264:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 31 00000100:00100000:2.0:1788463813.871293:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 32 00000100:00100000:2.0:1788463813.871299:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:57fb5382-3a22-4ad0-a646-5307bf61225a+5:2400:x1875339466951168:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463813.871322:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:57fb5382-3a22-4ad0-a646-5307bf61225a+5:2400:x1875339466951168:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 24us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463813.871328:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 32 00000100:00100000:2.0:1788463813.871339:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 33 00000100:00100000:2.0:1788463813.871345:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+5:2400:x1875339466950784:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463813.871367:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+5:2400:x1875339466950784:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 22us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463813.871373:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 33 00000100:00100000:2.0:1788463813.871384:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 34 00000100:00100000:2.0:1788463813.871389:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:57fb5382-3a22-4ad0-a646-5307bf61225a+5:2400:x1875339466951296:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463813.871410:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:57fb5382-3a22-4ad0-a646-5307bf61225a+5:2400:x1875339466951296:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 20us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463813.871415:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 34 00000100:00100000:2.0:1788463813.871434:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466950400 00000100:00100000:2.0:1788463813.871438:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466950400 00000100:00100000:2.0:1788463813.871455:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466950912 00000100:00100000:2.0:1788463813.871458:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466950912 00000100:00100000:2.0:1788463813.871471:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466950528 00000100:00100000:2.0:1788463813.871474:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466950528 00000100:00100000:2.0:1788463813.871484:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466951040 00000100:00100000:2.0:1788463813.871486:0:22627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466951040 00000100:00100000:2.0:1788463813.871497:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 75 00000100:00100000:2.0:1788463813.871503:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+26:2400:x1875339466950400:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463813.871533:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+26:2400:x1875339466950400:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 30us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463813.871547:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 75 00000100:00100000:2.0:1788463813.871560:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 76 00000100:00100000:2.0:1788463813.871567:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57fb5382-3a22-4ad0-a646-5307bf61225a+6:2400:x1875339466950912:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463813.871620:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57fb5382-3a22-4ad0-a646-5307bf61225a+6:2400:x1875339466950912:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 54us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463813.871627:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 76 00000100:00100000:2.0:1788463813.871639:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 77 00000100:00100000:2.0:1788463813.871646:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+5:2400:x1875339466950528:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463813.871669:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+5:2400:x1875339466950528:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 24us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463813.871676:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 77 00000100:00100000:2.0:1788463813.871689:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 78 00000100:00100000:2.0:1788463813.871694:0:22627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57fb5382-3a22-4ad0-a646-5307bf61225a+5:2400:x1875339466951040:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463813.871713:0:22627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57fb5382-3a22-4ad0-a646-5307bf61225a+5:2400:x1875339466951040:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 20us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463813.871718:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 78 00000100:00080000:0.0:1788463813.872827:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788463813.872834:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788463813.872838:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788463813.872841:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463814.533926:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf554a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485946880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463814.534004:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463814.534125:0:24136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485946880 00000100:00100000:2.0:1788463814.534135:0:24136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485946880 00000100:00100000:2.0:1788463814.534248:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788463814.534259:0:24136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485946880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788463814.534282:0:24136:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788463814.534331:0:24136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485946880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463814.534355:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788463814.534509:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf554a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485946880:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788463814.534563:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1788463814.596312:0:22662:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788463814.596323:0:22662:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788463814.596340:0:22662:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788463814.596350:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788463814.660260:0:24752:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788463815.504795:0:25710:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:1.0:1788463815.556783:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485947008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463815.556853:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463815.556923:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485947008 00000100:00100000:1.0:1788463815.556933:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485947008 00000100:00100000:1.0:1788463815.556992:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788463815.557007:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485947008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788463815.557046:0:22632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788463815.557094:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485947008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463815.557100:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788463815.557148:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485947008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463815.558395:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188e3e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485947136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463815.558448:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463815.558529:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485947136 00000100:00100000:0.0:1788463815.558537:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485947136 00000100:00100000:0.0:1788463815.558611:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788463815.558620:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485947136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788463815.558644:0:22631:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1788463815.558692:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485947136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463815.558699:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788463815.558750:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188e3e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485947136:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788463815.693742:0:22615:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463816.436183:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463816.436232:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463816.436346:0:24133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466951552 00000100:00100000:2.0:1788463816.436355:0:24133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466951552 00000100:00100000:2.0:1788463816.436432:0:24133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 31 00000100:00100000:2.0:1788463816.436442:0:24133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+8:2402:x1875339466951552:12345-192.168.204.53@tcp:16:kworker.0 00000100:00100000:2.0:1788463816.436561:0:24133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8274a4a-4839-4e48-85b1-f0993c4585d3+8:2402:x1875339466951552:12345-192.168.204.53@tcp:16:kworker.0 Request processed in 120us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463816.436568:0:24133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 31 00000100:00080000:1.0:1788463816.436752:0:22622:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463816.436917:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466951424 00000100:00100000:3.0:1788463816.436923:0:24137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466951424 00002000:00100000:3.0:1788463816.436950:0:24137:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff96188e3ced80 x1875339466951424/t0(0) o4->c8274a4a-4839-4e48-85b1-f0993c4585d3@192.168.204.53@tcp:197/0 lens 504/0 e 0 to 0 dl 1788463827 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788463816.436960:0:24137:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96188e3ced80 with x1875339466951424 ext(0->8) 00002000:00010000:3.0:1788463816.436966:0:24137:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96188e3ced80 00000100:00100000:3.0:1788463816.436990:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 0 00000100:00100000:3.0:1788463816.436998:0:24137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188e3ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+8:2402:x1875339466951424:12345-192.168.204.53@tcp:4:bash.0 00000100:00100000:3.0:1788463816.440010:0:24137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188e3ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c8274a4a-4839-4e48-85b1-f0993c4585d3+10:2402:x1875339466951424:12345-192.168.204.53@tcp:4:bash.0 Request processed in 3001us (3825us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1788463816.440036:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 0 00002000:00100000:3.0:1788463816.440049:0:24137:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff96188e3ced80 x1875339466951424/t12884901895(0) o4->c8274a4a-4839-4e48-85b1-f0993c4585d3@192.168.204.53@tcp:197/0 lens 504/448 e 0 to 0 dl 1788463827 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788463816.440059:0:24137:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96188e3ced80 with x1875339466951424 ext(0->8) 00002000:00010000:3.0:1788463816.440064:0:24137:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96188e3ced80 00010000:00010000:3.0:1788463816.707982:0:22614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 15152 lines, 15152 kept, 0 dropped, 0 bad.